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ABSTBACT 

Besults from the third national writing assessment of 
-.nine'-year-old students conducted in 1979 by the National Assessment 
Of Educational Progress (NAEP) are presented in this volume- Chapter 
one provides highlights of the results of the test assessment which 
indicate both decline and improvement on different tasks in the 
writing performance of nine-year-old students. Chapter twor gives an 
overview of the NAEP assessments^ a discussion of the populations 
assessedv a description of the written exercises^ and descriptions of 
jthcL^niet^ods of scoriilg: holistic^ primary traits analysis of 
rhetcricar~ef fectiveness/ and analysis of syntax and mechanics. 
Chapter three provides ah; indepth discussion of the results^ and 
chapter four gives an overview of tha writing of 9-yearroldr 
13-year-old^ and 17-year-old students . Chapter five offers some 
observations about writing in the United States and suggests 
implications of the results of.>the assessment for instruction. 
Appendixes include exercises^ documentation ^ scoring guides ^_ and 
sample ^papers: guidelines for syntax and mechanics analysis; group 
^results and exercises evaluated for primary trait and cohesion; error 
vfreqaencies for good and poor papers and selected groups; and the 
iJrackground questionnaire and group responses to background and 
attitude questions. (MKM) 
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FOREWORD 



When the U.S. Office of Education was 
chartered in 1867, one charge to its commissioners 
was to determine the nation's progress in educa- 
tion. The National Assessment of Educationn! 
Progress iN AEP) war in 
address,' in a systematic ways that charge.- - 

Since 1969, the National Assessment has gath- 
ered information about levels of educational 
achievement across the country and reported , its 
findings to the nation. It has surveyed the attain- 
ments of 9-year-olds, 13 -year-olds, 17-year-olds 
yand sometinies adults in art, career xind occupa- 
tional development, citizenship, literature, math- 
ematics, music, reading, science, social studies 
and writing. All aieas have been periodically 
reassessed in order to detect any important 
changes. To date. National Assessment has inter- 
viewed and tested more than 900,000 young 
Americans. - 

Learniug-area assessments evolve ! from a ; 
conseiisus process. Each assessment is the product 
of s^eral years of work by a great many edu- 
cators, scholars and lay persons from all over the 
nation. Initially, these people design objectives for 
each subject area, proposing general goals they 
feel Americans should be achieving in the course 



of their education. After careful reviciVS; these 
' objectives are given to; exercise (item) writers, 
whose task it is to create measurement instruments . 
appropriate to the objectives. 



When the ^ Exercises have passed extensive 
reviews by 1 subject-matter ' specialists, 
measurement experts and lay persons, they are 
adminij^tered to probability samples. The people 
who compose these samples are chosen in sucli a 
way that the results of their assessment can be 
generalized to an entii;e national population. That 
is, on the basis of the performance of about 2,500 
9-year«olds on a given exercise, .we can make 
generalizations about the probable performance 
of all 9-year-olds in the nation. - 

After assessment data haye been collected, 
scored and analyzed, the National Assessment 
publishes reports and disseminates the resuUs as 
widely as possible,: Not all exercises are released 
for publication. Because NAEP will readminister 
some of the same exercises in the future to 
determine whether the performance level of 
Americans has increased, . remained stable or 
decreac J, it is essential that they not be released 
in order to^preseri^e the integrity of the study. 
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CHAPTER1 



HIGHLIGHTS OF THE RESULTS 



Changes in the writing of 9-year-olds were 
assessed, with four writing exercised, and a fifth 
exercise provides further baseline information. 
One expressive exercise used to measure change 
across thpee assessments was evaluated holistical- 
ly, and another was evaluated for both cohesion 
and rhetorical effectiveness (primary trait evalua- 
tion). Both were exhaustively analyzed in terms of 
syntax and mechanics. The remaining tasks — one 
.expressive essay, ^one persuasive letter and one 
routine business letter—were jadged for rhetorical 
effectiveness. Exhibit 1-1 displays; national per- 
centages of good papers for^all of the writing 
tasks. Details of the assessments, of holistic-^ 
printary trait and cohesion scoring, and of syntax 
aind mechanics analysis appear in Chapter 2 and in 
the appendixes. Further results appear in Chapters 
3 and 4, and Chapter 5 presents an interpretive 
discussion of the results. 

Some major findings: 

• Holistic evaluation did not reveal significant.. 
. changes in the average writing performance of 

9-yeaT-olcis between 1970 and 1979. However, 
a 6% increase in papers rated 3 and 4 indicates 
that there may have been some improvement 
in quality. , . * 

• Rhetorical skill (measurecj, by primary., trait 
' _J evaulation) on a narrative lask (* -Fireflies") 

^ declined between 1970 and . 1979. In 1970, 
17%*^bf the students Avrote competent .papers, 
but in 1979, the figure dropped to 10%. 

• Rhetorical skill on an expressive essay 
(**Goldfish"):assessed in 1974 and 1979 re- 
mained stable. About two-fifths of the.9-year- 
olds wrote a marginal paper incjuding some 
detail, while about 13% >yrote papers;showing 
skill in elaboration. / 



• Rhetorical skill on a persusasive writing task 
(**Puppy Letter") remained the same between 
1974 and 1979. Proportions of students who 
included some appeals remained at somewhat 
less than half, while aboqt 16% in both assess- 
ments wrote letters containing good appeals. 

^ ■ ■•. 

• Rhetorical skill on a routine business letter 
suggested that 9-year-olds have less difficulty 
with straightforward tasks. In 1979, about 

^half wrote a successful letter *to order a cal- 
endar through the mail. 

• One measure of. coherence showed little 
change between 1970 an*"! 1979, with about 
22% of the students writing cohesive papers in 

^ both assessments. A different measure < on 
another task showed the percentage of co- 
hereiJt paragraphs increasing from 57% to 
72%. ' 

• Females wrote significantly more successful 
papers in each , assessment, and their ad- 
vantage appears to be remaining fairiy 
constant across time. 

• Although blacks improved their relative 
standing on the "Fireflies" narrative exercise, 
almost equaling the performance of the na- 
tion by 197^9, they performed significantly 
below the nation on the other exercises. 

• On the same **Fireflies" riarratiye. exercise, 
the disadvantaged^urban group gained in rela- 

" tive standing while the advaritag^d-urban 
group lost, v(\ih the result that by 1979 neither 
group performed significantly, different from 
the nation. However, on the rest of the tasks, 
the disadvantaged-urban group remained at a 
level below the nation, while the advantaged- 
urban group remained above the nation. 



EXHIBIT 1-1- National Percentages of 
Good* Papers, Age 9, 19*70, 1974, 1979 
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There are indications that the embedding and 
subordination skills of 9-year-olds may have 
improved from 1970 to 1979. 

Proportions in mechanical errors in the 
papers seem to have changed little between 
1970 and 1979. 

Writers seem to be divided into two camps: a 
majority who display a general grasp of 



written conventions and a minority who 
display massive problems with written lan- 
guage. 

• About half to two-thirds of the 9-year-olds 
appear to have positive attitudes about them- 
selves as writers. However, 'about a fifth to a 
quarter of them appear to harbor negative or 
defeatist attitudes. 



CHAPTER 2 



BACKGROUND 



A. Overview 

This report is based upon three national assess- 
ments of writing, the first in 1969-70, the second 
in 1973-74 and the third in 1978-79. Some writing 
tasks were included in all three assessments, per- 
mitting analysis of changes in student writing at 
three points during the 1969-79 decade. Other 
writing tasks were included in the ; last . two 
assessments, permitting analysis of changes during 
the last half of the seventies. ' 

The '^results reported in this voiiime are not 
based upon the writing of the same 9-year-olds 
over the nine-year period. Rather, they are based 
upon three different assessments. vNine-yeUr-olds 
attending school were first assessed in the winter 
of 1970.cFour years later, another national sample 
of 9-year-olds was assessed,, and five years afte; 
that yet another sample was assessed. Since e2lch 
-sample represented the national population of 9- 
year-oldsj the assessments can reveal whether the ^ 
writing skills of that age group are changing and in, 
whkt i;«spects. The assessment was not administer- 
ed to intact classrooms; rather, it was given to a 
randomly selected group of 9-year-olds who may 
or may not be receiving the same instruction in 
writing. . ' , 



B. Populations Assessed 

The target population for each of the three 
assessments consisted of 9-year-olds attending 
public or private schools. Details of the sampling 
design and procedures are explained in NAEP 
Report lO-W-40, Procedural Handbook: 1978-79 
Writing Assessment (19^0), and numerous other 
Assessment reports and monographs. Here it 
should be sufficient to say that each assessment 
employed a stratified, multistage probability 
sample design. About 2,400-2,600 responses were 
collected for any given writing task. Some- of the 
figures given in this report are based on an 
analysis of all 2,400-2,600 responses to a 
particular exercise,- and some are based upon 
national subsamples of 384-596 papers— a number 
sufficiently large to permit generalizations about 
an entire age group, but not large enough to 
permit statements ?ibout special subpopulation* 
such as rural youngsters. To obtain the repre- 
sentative subsamples of descriptive and narrative 
papers, scientific 'p^o^)ability subsamples were 
jdrawn from the total National Ass^essment 
^samples. Small percentages (1%-10%) of these 
subsamples wet'e nonrateabld papers that were 
excluded from further analysis. The sample sizes 
used for analyises in this volume appear in Table 2- 
1, below, and in parentheses (e.g., n = 384) on 
each table in the text. 



Essay 



(exptanation- 
business letter) 

Attitude 
questions 



TABLE 2-1. Sample Sizes for Results Presented 
in This Volume 

Analysis 







1970 


No. in Sample 
1974 




"Kangaroo" 
(narration) 


Holistic scoring 
Paraaraoh coherpnre 
Syntax and mechanics 


384 
384 
384 


409 
4nQ 

409 


494 
494 


"Fireflies" 
(narration) 


Primary trait scoring 
Cohesion 

Syntax and mechanics 


2,466 
2,466 
556 


2,573 
2,573 
584 


2,553 
2,553 
596 


*-Goldfish'*- 
(expression) 


Primary trait scoring 




2,611 


2,475 


"Puppy Letter" 
(persuasion) 


Primary trait scoring 




2,643 


2,494 


"Poster 
Calendar" 


Primary trait scoring 






2,49^ 



2,B31 



Whenever analysisS in based upon full samples of 
?^400-2,600, we can report results for a number of 
population groups defined by sex, race, region of • 
the country, parental education, type of commun- 



ity and grade in school. These are defined in Table 
2-2. The national subsamples of ; 'Tireflies'' 
permit reporting for only sex and race; the sub- 
sample oY** Kangaroo," only sex! I ' 



Sex 
Race 

Region 



TABLE 2-2. Definitions of Subgroups 

Results are presented for males and females. 

Results are presented for black students and white stuc » • . Data for Hispanic students are not re- 
ported because sample sizes for individual items are too small. , 

Results are presented for the Northeastern, Southeasteru, Central and Western regions shown on 
the followirig map. 




Parental . Results are presented for three levels of parental education: (JJ those whose parenrs did not gradu- 

education ate from high school, (2) those who have at least qne parent who graduaicJ from high school and 

(3) thostf who have at least one parent who has had some post high school education. 
• o • ' . . ^ ' " , . • . 

Type of Three extreme community types of special interest are defined by an occupational profile of the 

community ' area served by a school, as well as by the size of the community in which the school is located. 

/Advantaged urb(w (high metro). Students in this group attend schools in or around cities having a 
population greater than 200,000 and where a high proportion of the residents are in professional 
or managerial employment. 

Disadvantaged urban (low metro). Students in this group attend schools in or around cities having 
, ' a population greater than 200,000 and where a relatively high proportion of the residents are on 

welfare or not regularly employed. 

, Rural. Students in this group attend schools in areas with a population under 10,000 and where 
many of the residents are farmers or farm workers: » 



Grade in 
school 



this is the only reporting category that excludes a large number of respondents. About two-thirds 
do nm .fall into the classifications listed above. Results for the remaining two-thirds are not report- 
ed, since^^heir.performance is similar to that of the nation. 

Results are presented for 9-year-olds in grades 3 (25%) and 4' (72*^^0). ' - \ , 



In reporting^ group datav the following, abbre- 
viatidns have been used on tables and graphs: 



N. 
M 



= Nation' 
- Males 



F 
B 

SE 
NE 



= Females 
Blacks— 
= Whites 
= Southeast 
= Northeast 



c 


= Cenfral 


w 


= Wf^ct 

— TVCal 


NGH 


— Pnrpnfc HiH not oraHiintp from hioh 




cfhool 


GHS 


=s At Ipact orip narent cradiiatpd from 






PHS 


— At least one oarent with nost hish 




school eddcation v 


AU 


= Adyaiitaged urban (high metro) 


DU 


= Disadvantaged urban (low metro) 


R 


= Rural 


3 


= 3rd grade ' 


4 


= 4th grade . 



C. The Writing Exercises, Sporing 
Approaches and Descriptive Analyses 

Details of NAEP exercise development pro- 
cedures appear in NAEP Report lO-W-40, 
Procedural Handbook: 1978-79 Writing Assess- - 
ment (1980). Complete documentation of all exer- 
cises released af^er the third assessment of writing, 
including scormg: guides and sample responses/ is 
contained in 1 77?e Third ' Assessment of Writing: 

1978-79 Writiku Released Exercise Ser (1980). ^ " 

f» . ■■ ■ 

The writing exercises were created by experi- 
enced writing educators. Then they were field 
tested, refined and reviewed carefully before being 
used. .Each assessment contained exercises as- 
sessing several kinds, of discourse on the grounds 
that $tudents may be proficient in some kinds of 
, writing but not in others. Thus, we have gathered 
: inforniiation about expressive writing, descriptive 
, or explanatory writing and persuasive writing. 
Although some of the same skills are involved in 
each kind of writing, there' are* challenges and 
strate^iep unique -to each, as "the results amply 
illustrate. Although' an assessment thatancludes*' 
^man^, kinds of writing-.^ may b.e somewhat ; 
confusing, it is preferable to an assessment that 
relies upoii a single kind of writing. w 

. ' ■ ' ' , . - - ■. 

' ^Several types of srcoring and analysis went into 
the creation of the data in this report; Each is 
briefly described, below 'and iUustrated in* the text 
and appendixes.;, Readers desiring - more"^ 
information about these procedures should, 
consult the handbook and exercise, set cited above', 
as wdl as,Munis_(L980), Mullis^hd Mellon (1980), 
and Brown 1 1979), which also.-citfe additional ref- 



erences. For each procedure, raters scored a 
random mixture of papers collected from the dif- 
ferent assessments. Each kind of scoring was done 
by a different group of scorers. 

Holistic Scoring 

When readers holistically scoi'e^apers, they do 
not focus upon particular aspects of^a paper such 
as mechanics or ideas or organizatioiK^Rather, 
they concentrate upon forming an o vera// impres- 
sion of each paper relative to the other papers they 
have read. Their primary task is to rank order the; 
papers from best to worst, rjot to identify errors or 
to specify writing problems. ^ 

Results for the holistic scoring reported in this 
volume' involved several steps. First, the table 
leaders-r-all of whom were experienced ^holistic 
readers — surveyed the pool of papers from all, 
three assessments and ^.lected examples of papers 
representing four levels of quality. Then, they 
developed guidelines describing each level ^of 
quality and how to; distinguish between top-half 
atid bottom-half papers. "The scoring session 

. began with «ome discussion pf the characteristics 
•of the 'anchor papers and guidelines, and then 
included several practice scorings of other papers 
to refine the scoring scale description and iron out 
discrepancies among readers. 'When .alPreaders 
were comfortable .with > the guidelines (see 
Appendix A), tiiey scored papers for an hofir,, 
after which they discussed more anchor papers. 
Throughout the subsequent, scoring; there were 
periodic discussions of papers to insure that 

. ^ readers continued to holcl to the same standards. - 

Reliability of scoring was checked by having a 
random 10% of the papers read by pairs of 
readers who were matched to detect potential dis- 
crepancies. The readers agreed on 68% -^bf the 
papers. 

Papers from all three* assessments were 
holistically scored at the same scoring session to 
niake sure that all were evaulated by the same 
standards. " - 

The Primary Trait Scoring 
System (PTS) 

The primary trait approach to essay evaluation 



instance, the primary focus of the *Toster Cal- 
endar" exercise is upon ability to formulate a. 
request clearly enough to order somethirag through 
jhe mail. However, scorers also categorized such 
secondary matters as whether or not the letters 
contained appropriate greetings. 

Scoring guides Jot all PTS exercises appear in 
Appendix A. ' . 

^ . Cohesion 



involves isolating an important writing skill, 
developing -a task to measure it and articulating 
four levels of proficiency. When a reader is rating 
papers for PTS, he or she is rating each paper 
against criteria spelled put in the . scoring guide 
instead of rating each paper in terms of the entire 
pool of papers. Thus, whereas a holistic scoring 
tends to distribute a pool of papers over a **bell 
shaped curve," a PTS scoring will only distribute 
papers according to their relationship to the scor- 
ing criteria. If none of the papers meet the criteria 
for the highest rating, then so be it; the object is to 
describe the papers, not rank order them. 

Holistic scoring enables one to determine if 
a group of papers written at one time is better than 
a group written at another time,^but it does not 
provide much specific iniFormation about how the 
two groups differ. Primary trait scormg provides 
specific information about particular rhetorical 
aspects of papers,' but does not provide 
information about overall quality. Thus,- it is use- 
^fu^to do both kinds of evaulation whenever 
possible. V 

\ Training for PTS scoring involves thorough dis- 
cussion of the writing assignment, scoring guide, 
and sample papers. If the "assignment has been 
constructed tb elicit ^evidence of proficiency in a 
particular vriting skill, it should explicitly estab^ 
lish the writing situation, specifying the purpose 
of the communication, the audiencfc and what' 
must be accomplished. The instructions should 
unambiguously tell the writer what is required, 
and the scoring guide should unambiguously de- 
fine four levels of proficiency in the primary skill 
bting assessed. Generally, level "IV indicates no 
eyidehce of the skill; level "2^" inarginal evidences 
level ''3," solid performance; and level "4," very 
good perfori^ance. Scojers discuss each level and^ 
study- papers exemplifying each until everyone 
feels /comfortable with the system. Then scoring 
commences, with periodic discussion of trouble- 
some papers. All papers were rated independently 
by =^two. scorers, with disagreements bejng recon- 
ciled Jby a third scorer. Agreement between the 
first two score^-s rah^'.ed from 91 Vo to 97% for the 
set of papers included in this report. 

' Some. PTS exercises require readers to look for 
secondary aspects of the papers as well. For 



The term cohesion refers in general to the many . 

, ways words and ideas are linked together in 
writing to create a sense of wholeness and co- 
herence. The cohesion scoring (see guide, 
Appendix A) required readers to sort papers into 
groups representing four degrees of cohesiveness. 
Papers,in the lowest group (level 1) display no or 
few connections between sentences and are loosely 
structured. Papers in the next group (level 2) 
display attempts to tie ideas^together h^re or theire 
but do not show any unifying structure. Cohesive 

, papers (level 3) display gathering and ordering of 
details; and ideas, and fully coherent- papers (level 
4) display a numlier of strategies and devices ,th^t 
bind the narrative into a unified whole. 

Readers discussed the sc6ring criteria, sample 
papers, and ^cohesive ties and strategies*^ before 
undertaking the scoring. Scoring Rroceded very 
much Jike the scoring for .PTS, with periodic 
checks for consistency and reliability. Also, as^ 
with the PTS evaluations, each paper»,was r^ted by 
at least two readers. The percent of agreement was 
93% to 94% for each of the tbi je sets of papers. • 

Syntax arid Mechanics ' 

In addition to being rated for quality, the 
"Fireflies" and **Kangaroo" papers were also 
analyzed in terms of their syntactic and 
''mechartical" features. Syntax refers to the ways 
in \yhich words kre put together to form phrases, 
clauses, and- sentences. Mechanics refers: :to the 
ways in which writers handle bd'^ic conventions of 
writing such as punctuation, spelling or word 
choice. A syntactic analysis involves breaking up 
each paper into its l*T-units" (a T-unit is a mafn 
clause^ \yith all its. attendant^ modifying words^ 
phrases and dependent clauses) and examining the 



ways in which writers ^embed information in T- 
units and join T-unik together. A mechanics 
analysis involves classifying the kinds of errors 
writers make in sentence use, punctuation, 
spelKng, and so forth. 

Bpth kinds of analysis were done by experienced 
English teachers thoroufjhly trained in grammar, 
usage and linguistics. After the papers ha(J been 
coded by two to four scorers for sentence types, T- 
units, embeddiiig, modiflcation, conjoining, « 
mechanics errors and the like, the coded essays 
were keypunched and the results tabulated to 
prdduce the results presented in this report. 

Outlines listing the syntactic features analyzed 
in this ^report appear in Appendix B. More 
complete information is also available in Mullis 
and Mellon (1980). 

D.The Analysis and Data Presentation 

. National Assessment reports the performance 
of groups bf students, not individuals. For pri- 
mary trait and cohesion ratings, the basic measure 
of achievement reported is the percentage of 
papers at each score level or a combination of the 
Ijest score levels. Increases or decreases in the per- 
centage^^of good responses between assessments 
are used to indicate, trends in achievement for an 
age level or'a subpopulation of interest. ' 

Tables presenting primary trait results offer per- 
centages for score points 1, 2,^ and 4, as well as 
for 2,^3 and 4 combined, 3 and 4 combined, arid 0 
(nonrateable). The 0 category includes people who 
did not respond to the:exercise,„wrote on an^a 
gether different topic or wrote so illegibly their 
papers could not be ;^cored. Holistic scoring in- 
fbrmation is presented in terms of percentages of 
papers at each score ppii)t and average (mean) per- 
foripance each assessmen^%ar; ; . 

; For the descriptive information about syntax 
"^and nijchanics; "data are presented to illustrate the 
;ange of; performance as well as the average pef- 
fornjancc. Syntax and mechanics tables present 
Tnean^Knicdians, quartiles find the top deciles. 
The meaitKof course, is an average across all the 
paporsTQuartiles present a more accurate picture- 
of 'the entire distribution by providing the value of 



the papers at the 25th percentile (Ql), at the center 
point (median) and at the 75th percentile (Q3). 
The top decile (9Qth percentile) is the value above 
which 10% of the papers fell. Quartiles and deciles 
are unrelated to quality jud^^merits; they simply 
give the values at various points of the distribution 
of whatever is being counted— adverbial modifica- 
tions, number of misspellings, or whatever. These 
.tables, then, should help the reader to see the 
range of the papers— something that averages tend 
to obscure. 

Because, the numbers and percentages presented 
in this report are based upon samples, they are. 
neceissarily^'stiniates, not definitive figures. They 
are. of course, our best estiinates; but they are 
subject to the qualification that a certain amount 
of measurement and ribnmeasurement error 
creeps into even the '^est estimates. Thus, for 
example,' the figure 20% is really 20% plus or 
minus a certain (usually small) margin of error. 

' Natior.al^Assessment computes standard ekrors 

that estimate the sampling error and other random 
error associated with the assessment of a specific 
item . N AEP has adhered to a standard con venit ion 
whereby differences between statistics are des- 
ignated as statistically signi ficant at the .05 level of- 
significance. T|iat is, differences are highlighted, 
only if they are at least twice as large as their 
standard errors^ Differences this large would 
occur by chance in few"er than 5% of all possible 
replications of the sampling, data collection and 
scoring procedures for any particular age group or 

L . reporting group. If a national figure was 20% and 
if the standard error of the female percentage was 
.5 points^ 22% would be noted as "significantly** 
(in jjhe statistical Sense) different from 20%, 
because itMs more than twice the standard error 
away from 20%'i But if the percentage for females 
was 20.5%, it would not be at least twice the 
standard! error away from 20, so it would not be 

-~r>^ termed a statistically significant difference. 

Group, differences and change differences are 
asterisked in this, report if they are statistically 
significant • in the sense just described. If, in the 
appendix tables,, a group difference from the 
national percentage is asterisked, it represents a 
statistically significant difference at the .05 level:' 
If it is not asterisked, we are less confident that the 



two numbers, differ. The same applies to any 
change percentage: an asterisk indicates statis- 
tically significant change, and no asterisk indicates 
that there ?riay not be a difference between the 
figures. It is important, however, to distinguish 
statistical significance from educational signifi- 
cance. A difference of 3 or 4 points betwten group 
and national performance migfirbF^statistically 
significant but too small to merit serious educa- 



tional concern. One can also imagine a situation in 
which many changes are negative but no one of 
. them is statistically significant; it could be that the 
overall pattern of negative changes has education- 
al significance. Readers must decide for them- 
selves how important particular changes or dif- 
ferences are in the real world, for statistical 
conventions can aid, but not replace, good judg- 
ment. ~ — — 



CHAPTERS 
THE WRITING OF 9-YEAR-OLDS 



A. How Good Are the Papers? 

Most 9-year-olds are in the fourth grade. They 
have had some instruction in writing, but not a 
great deal, and they have many years of de- 
velopment ahead of them before they reach ma- 
turity as writers. Nevertheless, they can write, 
often enthusiastically, about any number of topics 
appropriate for their age. 

The assessment of 9-year-olds included three 
expressive tasks, one persuasive t^k and a short 
business letter.^Ohe of the expressive essays re- 
quiring *a narrative was scored holistically, and the 
rest of the tasks were scored for rhetorical effect- 
iveness using primary trait guides. 

1. Holistic Judgment of an Expressive 
Narrative Exercise, 1970, 1974, 1979 

The children were shown a picture of a 
kangaroo jumping over a fence and were asked to 
write a story about what might be happeiiin^ in 
the picture (see Appendix A for the actual writing 
task). Stories written in 1970, 1974 and 1979 were 
randomly mixed together and scdred holistically 
along lines described ^iri Chapter 2^ Holistic 



scoring involves training a group of scorers to read 
large numbers of ess.ays and rank order them from - 
worst to best in terms of overall quality. The 
scorers had general guidelines (see Appendix A) 
and papers exemplifying four levels of quality. 
They practiced on sample papers until they were 
scoring consistently. Then, they read each paper, 
formed a general impression of it's overall quality 
relative to the other papers they read and gave it a 
ratingof 1,2, 3or4.. 

" The National Assessment did' not conduct three 
separate holistic scorings in order to gather the 
change data described in this chapter. Rather, 
papers wpitten in all three- years were randomly^ 
ordered into a single pool and scored in a single 
session. The scorers did npt know in which year 
any particular paper was written, so they nec- 
essarily applied the same criteria to all papers.. 
After the scoring, the ratings were examined to 
determine whether those papers written in differ- 
ent years were perieived, as^a group,'t6 be worse 
or better than |he others. Table 3-1 displays the 
percentages of 1970,|vl974 and 1979 papers at each 
score point. Fr^ibit 3 1 displays changes in the 
mean holistic score bvei the years. 



TABLE 3*1. Percentages of Narrative Papers at.Each 
. Holistic Score Point, Age 9, 1970, 1974, 1979t 



Year 








Holiotfc Score. 






1 


2 


- 3 




3*&4 

■s 


Mean 


1970 (n = 384) 


12.5% . 


45.1% 


32.6% 


9.9% 


42.5% 


2.42. 


1974 (n= 409) 


10;0 


45.2 


32.0 


12.7 


44.7 


2.51 


1979(0^494) . 


10.7 


40.9 


36.4 


11.9 


48.3 


2!:54 


Change 








' 2.8 




0.08 


1970-74 , 


-2.5 


0.1 


•0.6 


2.2 


,1974-79 


. 0.7 ■ 


. -4.3 


, 4.4 ^ 


•0.8 


3.6 


. 0.04 


1970-79 - 


-1.8 


-42 


3.8 


2.0 


5.8 


' 0.12 



tPercentages may not total due to rounding error. 



CHAPTERS 



THE WRITING OF Q-YEAR-OLDS 



A. How Good Are the Papers? 

lost 9-year-olds are in the fourth grade. They 
J had some instruction in writing, but not a 
1 deal, and they have many years of de- 
pment ahead of them before they reach ma- 
:y as writers. Nevertheless, they can write, 
n enthusiastically, about any number of topics 
ropriate for their age. 

he assessment of 9-year-olds included three 
ressive tasks, one persuasive t^k and a short 
ness letter.^ One of the expressive essayS' re- 
ing*a narrative was scored holistically, and the 
of the tasks were scored for rhetorical effect- 
less using primary trait guides. ^ 

lolistic Judgment of an Expressive 
arratlve Exerc5se, 1970, 1974, 1 979 

he children were shown a picture of a 
garoo jumping over a fence and were asked to 
:e a story about what might be happemni? in 
picture (see Appendix A for the actual writing 
:). Stories written in 1970, 1974 and 1979 were 
domly mixed together and scdred holistically 
ig lines described nil Chapter 2^ Holistic 



scoring involves training a group of scorers to read 
large numbers of ess.ays and rank order them from - 
worst to best in terms of overall quality. The 
scorers had general guidelines (see Appendix A) 
and papers exemplifying four_ levels of quality. 
They practiced on sample papers until they were 
scoring consistently. Then, they read each paper, 
formed a general impression of it's overall qpality 
relative to the other papers they read and gave it a 
ratingof 1,2, 3or4.. 

" The National Assessment did'not conduct three 
separate holistic scorings in order to gather the 
change data described in this chapter. Rather, 
papers wpitten in all three- years were randomly^ 
ordered into a single pool and scored in a single 
session. The scorers did npt know in which year 
any particufar paper was written, so they nec- 
essarily applied the same criteria to all papers. . 
After the scoring, the ratings were examined to 
determine whether those papers written in differ- 
ent years were perieived, as^a group,'to be worse 
or better than the others. Table 3-1 displays the 
percentages of 1970,| 1974 and 1979 papers at each 
score point. F"hibit 3 1 displays changes; in the 
mean holistic score over the years. 



TABLE 3*1. Percentages of Narrative Papers at.Each 
. Holistic Score Point, Age 9, 1970, 1974, 1979t 



Year 



1970 (n = 384) 
1974 (n = 409) 
1979(0^494) 
Change 
1970-74 ^ 
,1974-79 
1970-79 - 



1 


2 


\ 3 


Holiottc Score. 


3&4 

■s ■ 


Mean 


12.5% . 

10;0 

10.7 


45.1% 

45.2 

40.9 


32.6% 

32.0 

36.4 


9.9% 
12.7 
11.9 


42.5% 

44.7 

48.3 


2.42 
2.51 

2!:54 


-2.5 

. 0.7 ■ 
-1.8 


0.1 
. -4.3 
•4,2 


.0.6 
. 4.4 " 
3.8 


' 2.8 
-0.8 
2.0 


2.2 
'3.6 
5.8 


0.08 

. 0.04 

' 0.12 



tPercentages may not total due to rounding error. 



The data do not show dramatic changes from 
year to year, but they provide some evidence that 
the 1979 papers may be somewhat , better than 
thosie written in earlier assessments. A slow, but 
steady, improvement appears to have taken place, 
as papers have moved^out of score points 1 and 2 
into score points 3 and 4. The percentage of 
papers in score points 3 and 4 increased from 42% 
in 1970, to 45Vo in 1974, to 48% in 1979. In 
addition, the mean holistic score of the 1979 
papers was .12 higher than the mean of the 1970 
papers. This change is not statistically significant, 
but it is a. steady, positive change. The evidence 
suggests that the quality of 9-year-olds' narratives 
has certainly not decreased and may well have im- 
proved slightly between 1970 and 1979. 

2.^Judgments of Rhetorical Skill . -^^^^^^-"'"''"^ 

Rhetorical skills come into play whenever one is 
concerned with the effectiveness of something 
written. Did the writer consider his or her 
audience's needs? Issthe tone of the wfiting likely- 
to help or prevent the writer from achieving the 
purpose iSebind the writing task? The National 
Assessment objectives for writing (Writing Ob- 
jectives, Second Assessment, \9li) suggest that 
even 9-year-olds must learn elementary rhetorical 
skiltjs so they can begin to write for different^ 
audiences under different circumstances. 
Accordingly, responses to* four writing tasks were 
judged for rhetorical effectiveness. 

The rating criteria used sp^ify four levels of 
quality from inadequate to very good. Inadequate 
papers do little or nothipg to address Ihe specified 
task, whereas adequate papers reflect control of 
the skills the exercise demands. More detail on this 
approach, called" the' primary trait system (PTS>i 
appears in Chapter 2 and in Mullis (1980). 
Primary trait scoring differs ft om holistic in'that it 
limits .judgments to clearly specified rhetorical 
considerations and ignores other features *of a 
p^iper, such as mechanics. , . 

Nine-year^lds were asked to write a narrative, . 
a fantasy, a letter persuading a landlord . to let , 
them keep a puppy and a r^^^^ a poster 

dtleridar through the m it would 

' take far more than four Writing samples to obtain 
a compfehensive view of how well 9-year-olds can 
'write under iiffererit circumstances and for dif- 



ferent audiences. Nevertheless, the following 
results can contribute to our knowledge about 
some aspects of their strengths and weaknesses. 

a. Expressiv/e Writing 

Expressive writing is writing done primarily for 
fun and self-expression, rather than some .other 
purpose, such as explanation or persuasion. This 
by no means diminishes its importance, for the 
skills involved in expressive discourse are central 
to all kinds of communication. 

In fact, particularly Tor younger students, many 
teachers qapitali|e^lUhft-ent^^ by 
^expressivr'wiridng ta and develop students' 
writing skills by ph)Viding frequent expressive 
opportunities. 

One expressive writing task given in all three 
assessments was to write a story about & picture of 
a girl collecting lightning bugs or fireflies. Nine- 
year-olds, were asked to look at the^ picture and 

- think about what the girl was doing and what ohe 
might d6 ne^H^The specific task' was to "write a 
story that {ells what the picture is about"— in 
other words, to invent aVarr8^.tive that explained 
the situation in the/ picture. The* papers wefc' 
evaluated £cccording to the scoring guide detailed 

An Appendix A. Briefly the four levels of quality 
w?re defindid by the following criteria: 

1 = Some explanation, but ho narrative inven: 
' tion. These responses tend to provide some 

minimal information or explanation about 
the picture by simply and briefly answiering 
^ thequestioiis. 

2 - Moderate to ample explanation, but little 

or no narratiye invention. IlYlqsq respons- 
es provide moderate to ample details ex^ 
plaining or describing the picture, but those 
details are not set in a story frameworkc . 

. 3 = Imaginative . explanation, by means of nar- 
^ rative* invention. ThQSQ p^pQTs invent .'de- 
tails about what is happening and cast them 
into a narrative framework. They use sev- 
eral storytelling -devices sucK as naming 
/characters setting scene, temporal or cas- 
ual lijrikinj, diajogue, and so oi\. Howr 
ever, the stories are not sustained. 



4 - Imaginative explanation, by means of de- 
veloped and controlled narrative inven- 
tion. These responses explain the picture 
through a fully controlled and detailed 
story. They se* the scene,, immediately, in- 
• vent 'moderate to ample details, ca§t the de- 
tails into a narrative without lapses and 
provide a conclusion to their story. 

' t ' . . "■ . 

The national results, found in Table .3-2, show 
that this.was not an easy task for 9-year-olds* The 
tendency was to **teirVor explain about the pic- 



ture, not to invent a story. In 1970 and 1974^ only 
abpui 16% of the 9-year.olds wrote a narrative 
judged to be level 3. or 4; in 1979, the proportion 
dropped to 40%: If category 2 is included, thfe 
proportion increased frqm less than tijvo-thirds in^ 
1970 to a high o'{\almost three-fourths Th' 1974 and 
then dropped down'kgairi to two-thirds in 1979. 
What locked like a trend toward improvement 
between the first -two assessments lost strength 
between the second twb, particularly at the higher 
score poirits. ^ 



TABLE 3*2. Percentages of 9-year*0lb$^at Each 
Primary Trait Score Level, "Fireflies" Exelrfse, 
1970,1S74,1979t 



Year ' 








Score Point 








Non- 


Some 


Ample 


Ade- 


Develo- 


Margin- 




rate- 


' Expla- 


^xpla- 


quate 


oped . 


al or 




able 


nation, 


< nation, 


Story • 


Story 


Better 






No story 


Little/No 












Story 










0 


1 


2 


^ ' - 3 . . ; 


4 


2,3&4 


1970 {n= 2,466) 


5.4% 


31.7% . 


' V 46.1% 


14.8% 


.1.9% 


G2.8% 


'1974 {n = 2,573) 


4.3 


21.8 


58.4 


14.0 


1.4 


73.9 


1979(0:^2,553) 


3.3 


29.3 


57.3 


9.4 


o:6 


t^7.3 ' 


Change 












1970-74 ' 


1^2* 


* -9.9i . 


12.4*- 


-0.8 


-o>: 


ti.r 


* 1974-79 


■1,0 


7.5- , 


-1.1 


-4.7* 


-0,8* 


-6.6* 


1970-79 : 


-2.0* 


-2.4 


. 11.2' 


■5.4* 


-1.3* • 





*Sta*JsticaHy.signif leant at the .05 level. 
tPercentage^s may not total due to rutno:. 



Compe- 
tent or 
Bettor 



3&4 

16.8% 

15.5 

lOlO 

-1.3 

•5.5* 

-6.8* 



Exhibit 3-2 displays group results' for students . 
receiving ^scores of 3 and ^4, aYid Exhibit J-^ dis-: 7 
plays group results, for students receiving scores of 
2, 3 and 4. Table Ol in Appendix C presents the 
differences 'between group performance and that 
of the nation. Oirls still appear to write more good 
essays than boys, with the difference in their per- 
formance remaimng about 6-8<?b in each assess- 
ment for papers rated 3 and 4 and increasing from 
13% to 19% for papers raicJ 2^ 

Black youngSLers, as a group, made' steady pro- 
gress relative, to the nation by writiiig abo^u the 
same proportion of jjapers fated 3 and 4 while the 
nation declined. Thus; the blacks' difference was 
12 points below the national level In i 970, but 
shrank a nonsignificant 3 points below in 1979. 



Likewise for their percentages of papers rated 2, 3 
or 4: in 1970, the group w|is 2^. points belt the 
nation; but by 1979 it .was only 6 points below. 

A, similar phenomenon bccufred. witli the 
community groups^AVhile the disadvantaged- 
urban group stayed! at about-the sanie percentage 
of 3 and 4. papers in each assessment (pj;rhaps ' 
because k coiiid go- no lower), the aldvantaged- 
. urban group* declined from assessment to assess- 
ment. Their percentage of 3^ and 4 papers .wast26%/ 
in 1970, 21% in 1974 and just iinder.lS% in4979j . 
Thus, the difference between each of these t^^ " 
groups and the nation appeared'to shrink^bnsid- 
erably, with the result that in 1979 neither'group 
was performing at a level significantly different 
from that of the nation. When 2, 3 aind 4 papers . ! 



EXHIBIT 3-2* Group Changes in Percentages of "Fireflies" Papers Rated 3 and 4, 
Primary Trait, Age 6, 1970 to 1974 and 1974 to 1979 



Region. 



Sex 



Race 




1970 

NE 21.6% 

W 17.9 

C 14.8 

SE 11. 6 - 

N 16.8 



1974 

iLo% 
17-;- 4 

18.7 
9.1 
15.5 



1979 

8.3% 
11.3 
11.1 

9.5 
10.0 




1970 

20.1% 
13.5 . 
16.8 



1974 

18.6% 
12.1 
15.5 , 



1979 

14.2% 

6.0 
10.0 




1970 . 

19.3% 

5.2 
16.8 



1974 

17.4% 

6.0 
15.5 



1979 

10.7% 

7.2 
XO.O 



--15 



--10- 



--5 



J-0 



*S-!T.-.""' 
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EXHIBIT 3-2 (Continued), Group Chainges in Percentages of "Fireflies" Papers Rated 3 and 4, 
Primary Trait, Age 9, 1970 to 1974 and 1974 to 1979 



Parental Education 



PHS 




NGH 



Grade 



60\_.. 

I:.. . 

■55 
50.. 
45 
40 

35 

30 - . 

25 

20 - - 
15 - - 
10 

5 

0 . 



These population groups represent about one-third ''f the sample. 



Type of Community^ 



AU 



DU 




1970 


197,4 


15 79 




1970 


1974 


1979 




1970 


1974 


1979 


PHS 23.5% 


21,6% 


11,4% ' 


4 


20.3% 


17.8% 


11.4% 


AU 


26.0% 


21.2% 


14.5% 


GHS 17.4 


16,9 


11.5 


3 


• 5.1 


6.2 


6.2 


R 


8.5 


23.2 


10.6' 


NGH 11.5 


11,3 


7.2 


N 


16.8 


15.5 


10.0 


DU 


4.5 


4.1 


5.9 


N 16.8 


15,5 


10.0 










N 


16.8 


15.5 


10.0 
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EXHIBIT 3 -3. Group Changes in Percentages of "Fireflies" Papers Rated 2, 3 and 4, 
Primary Trait. Age 9. 1970 to 1974 and 1974 to 1979 



-I- 



Region 



^Sex 



Race 



SE 






H 



/ 



I 



1970 

NE 69.5% 
W (50.3 
C 64.5 

SE 54.0 
N 62.8 



1974 

77.5% 
71.6 
^75.1 
69.9 
73. V 



1979 



69.6% 



63 
71 
65 
67 



1970 

F 69.3% 
M 5^.6 
N 62.8 



1974 

82.3% 
64.8 
73 .9 



1979 

76.9% 

58.1 

67.3 



1970 

W 68.8% 
B 36.9 
N 62.8 



1974 

77.3% 

56.1 

73.9 



1979 

68.8% 

61.0 

67.3 
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EXHIBIT 3-.3 (Continued). Group Changes in Percentages of "Fireflies" Papers Rated 2, 3 and 4 
Primary Trait, Age 9, 1 970 to 1 974 and 1 974 to 1 979 



0% -r 



Parental Education 



I-HS 68.9% 

■ GHS 68.4 

. NGH 56.1 

N 62.8 



79.1% 
77.3 
68.5 
73.9 



1979 



74.0% 
69.9 
51.7 
67.3 



1970 



1974 



4 71.6% 78.1% 
3 35.4 57 i 5 

N 62.8 73.9 



1979 



-73 . 0% 

53.0 

67.3 



Type of Community* 




'i}ese population groups represent about one-third of the sample. 





1970 


1974 


1^79 


AU 


78.2% 


81.7% 


73.2% 


R 


51.8 


72.4 


72.2, 


DU 


32.1 


49.0 


57.0 


N 


62.8 


73.9 


67.3 
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are considered, the disadvantaged-urban group 
improved substantially with each assessment, 
from 32% in 1970, to 49% in 1974, to 57% in 

, 1979. In contrast, the advantaged-urban group djd 
not perform appreciably different from assess- 

-^ent—to-^ssessnient^ The-HHiral— gi^oup— aho 

improved it's relative standing by not declining 
like the nation for papers rated 3 and 4. When 
marginal papers are also included, this group 
improved 16 percentage points from 1970 to 1979. 

The Southeast also improved its relative 

— standing-to-about- that-of-the-natiGn~on-papers 

rated 3 and 4 by staying at about thti si-.me per- 
formance level while the nation ciecUned and 
improving considerably on papers rated 2, 3 and 4 
while the nation did not. Conversely, by declining 
twice as much as the nation for papers rated 3 and 
4, the Northeast lost its relative advantage. Al- 
though the NortiKJast appeared to have improved 
between the first tw\assessments for papers rated 
2, 3 and 4, in the third assessment it dropped back 
again, to about the national level. 

Another expressive task asked 9-year-olds to 
imagine what it would be like to be something 
besides a person— for example, a goldfish, 
airplane or tree. More specifically, the task was 
this: 

Sometimes it is fun to think about v^hat it 
would be like to be something besides a 
person. What would it be like to be a 
goldfish? Or an airplane? Or a horse? Or 
a tree? Or any other thing? 

Think about what you would like to be. 
Write the name of the thing In the box be- 
low. Then write about what it is like to be 
that thing. 

Competent j^riters would choose some other 
form of existence and elaborate upon it with ap- 
propriate details. Consequently, the lowest-score 
papers were those that offered little or no expres- 



sion of what the thing they have chosen to write 
about is like and the best papers contained conr 
Crete details and were organized and Unified by . 
narrative frames. The four levels of performance 
are biiefly described below. (See Appendix A for 
-complete-excrcise4ind^cor4ng-guide.) — 

1 = Little or no expression of what the thing is 
like. These'responses are either very sparse 
or the information is too vague to help par- 
ticularize the thing the writer wants to be. 

2 - Moderate expression of yvjmjhc thing is 
like. These responses arie moderately de- 
tailed. Yet their expression of what the 
thing is like remains incomplete or frag- 
mented. 

. i - Detailed expression of what the thing is 
like. These responses particularize the thing 
but lack elaboration and unification of de- 
tail. 

4 .= Consistent and vivid expression of what the 
thing is like. These responses are highly de- 
tailed '&nd are unified by the presence of 
some kind of expressive or logical principle. 

Table 3-3 shows that this was a difficult task for 
the majority of the children. In 1974 and 1979, 
13% to 14% of th,e papers received scores of 3 or 
4, and 37% to 40% received scores of 2, 3 or 4. A 
few more may be able to do a minimal job today 
than could do so five years ago, but the increase is 
not significant. Probably, since levels 3 and 4 
require details that are specific to a particular 
thing, these will always be difficult criteria for 9- 
year-old children to meet. The tendency at this age 
level was to ascribe ''human" nonspecific char- 
acteristics to whatever was selected. For example., 
"I would play all day," "I would eat whatever I „ 
want," and so on, rather than something along 
the lines of "I would chase mice, tease the dog and 
sharpen my claws all day." 
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TABLE 3-3. Percantages of 9-Year-Olds at Each 
Primary Trait Score Level, '^Goldfish" Exercise; 1974, 1979t 



Year 


Hon- 
rate- ; 
able 


Little 
At>out 
Thlnp 


Some 
Details 


Score Point 
Elab- 
orated 
Thing 


Unified 
Detailed 
Thing 


Margin- 
al or 
Better 


Compe- 
tent or 
^ Better 




0 




2 


3 


4 


2,^&-4 


3&4 


1974 (n = 2,011) 


4.6% 


58,5% 


23.5% 


11.8% 




36.9% 


13.4% 


1979 {n = 2,475) 


3.r 


56.8 


26.4 


12.5 


1.2, 


«0.1 


1.3.7 


Change 
















1974-79 ' 


-1.5 


•1.7 - 


2.9 


0.7 


-0.4 


0.3 


0.3 



tPercentages may not total due to roundl.ig error. 



Exhibit 3-4 displays group patterns for 3 and 4 
papers, and Exhibit 3-5 displays group results for 
papers receiving scores of 2, 3 and 4. Table 03 in 
Appendix C presents the difference between the 
performance of each group and that of the nation. 
When cnly the top two scores are considered," little 
seems to have happened that is statistically sig- 
nificant except that the Western group appears to 
be performing closer to llie national level and the 
rural group appears to have moved ; about 
below the nation. Also, students^ whose parents 
did not graduate from high schojpl improved to 
about the national levy and those with at least one 
parent with pxjst hi^h school education lost their 



relative advantage. Blacks may have fallen slightly 
farther below the nation, from 6 to 8 percentage 
points. 

When scores 2, 3 and 4 arc combined, the 
advantaged-urban group remained above Rational 
levels of performance by perhaps improving more 
than the nation, while the black students remained 
t^elow the national level of performance, perhaps 
losing ground. In addition, the West dropped to 7 
points beioy; i;he nation in 1979, while the Central 
region improved 11 points^ 8,^oints more than the 
nation. ^ 
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EXHIBIT 3-4. Group Changes in Percentages.of "Goldfish" Papers Rated 3 and 4, 

Primary^Trait Age9, 1974to 1979 - 

Region * Sex ' Race* . 




F 
N 
M 





1974 


197? 




197/: 


1979 




NE 


14.0% 


15.5% 


F 


16. t% 0 


18.1% 


W 


W 


10.1 


11.8 


M 


9.9 


9.8 


B 


c 


14.3 


14.3 


N 


13.4 


13.7 


N 


SE 


14.7 


13.4 










N 


13.4 


13.7. 











1^74 

14.7% 

7.9 
13.4 




EXHIBIT 3-4 (Continued). Grou^) Changes in Percentages of "Goldfish" Papers Rated 3 and 4, 

. Primary Trait. Age 9, 1974 tg 1979 
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EXHIBIT 3-5. Group Changes «n Percentages of ''Goldfish" Papers Rated 2, 3 and 4, 

Primary T^ait, Age 9, 1974 to 1979 



■Region 



Sex 



Race 



55 . - - 



50 



45 



>40 - - . 



35 





25 



7 0 



1974 

NE 38.3% 

W 37.6 

C 36-9 

SE. 34.2 

N 36.9 , 



1979 

41.4% 

33.4 

48.3 

36.7 

40.1 



1974 

42.0% 

31.8 

36.9 



1979 

44.2% 

36.5 

40.1 



1974 

39.5% 

23.4 

36.9. 



1979 

44.3% 

20.4 

40.1 



70%- ^ 



EXHIBIT 3-5 ( Continued). Group Changes in Percentages of "'Goldfish" Papers Rated 2, 3 and 4, 

Primary Trait, Age 9, 1974 to 1S79 



Parental Education 



Grade, 



...Type of Community* 



65 



60 



35. 



;0: - - 



PHS 



15 



10--- 



15 



0 




NGH 



^ AU 



' 40 ; 
-L35; 



5 



5 



- - 15 



0 . . 

0. X 



1974 

PHS 41.2% 

GHS 38.3. 

NGH 31. ^3 

N 36.9 



1?79 
47.4% 

33\1 
40. 1^ 



1974 

4 41.7% 
3 21.2 
N 36.9 



'jftese population gr^^ps represent about one-thizd of the sam 



pie. 



1979 

44.4% 

28.5 

40.1 



1974 

AU 47.0% 

R 35.2 

DU 24.3 

N 3 6. .'9 



1979 



55;0%- 
34.1 
22.1 
40.1 



--10 
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b. Persuasive Writing . 

Expressive writing provides training in 3 mul- 
titude of skills and strategies for elaborating, 
being precise -and making qpncrete what one wants 
to say. These skills are useful in all the ctlaer 
modes of discpurse as well. Persuasive writing 
calls for additional skills in argument, logic and 
presentation. ^ 

For a persuasive writing task, 9-year-olds were 
asked to imagine they were moving into a new 
apanment_ where dogs ^ banned and had to 
write^ the landlord a letter a^jking that they be 
allowed to keep their puppy. T)ie task requires a 
letter that describes the siiua/don and presents 
arguments that might change the landlord's 
mind — either reasonable arguments or appeals to 
the landlord's feelings. Accordingly, the PTS 
scoring (detailed in Appendix A) df^fined the fol- 
lowing four levels of quality: 

1 Letters lacking dppeats/ reasons. These 
letters either contain no appeals or only 
name inappropriate or vague reasons. They 



- -J- 

may be confusing as to their request, threat- 
ening or make a request but offer no rea- 
sons. 

2 = Letters with limited appeals/reasons. Let - 

ters in this category vary, but all are in some 
sense ^Underdeveloped. Some offer only 
minit^l appeals, others supply reasons but 
failti) state the request, and still others be-- 
come belligerent. „ 

3 - Lejtters substantiated with appropriate 

afipeals/reaj^ons. Generally, these letters in- 
clude a requ^^ ^ ubstantiater* with r-^^^i^x- 
imately three concrete appeaia. 

4 =^ Letters deveU ed and substantiated with 

appropriate appeals/ reasons. These let- 
ters are organized such that they operate n 
a unified piece of persuasion. They tend to 
have openings, closings and numerous ap- 
. propriate appeals. 

lable 3-4 displays the percentage of papers 
falling in each category for the two assessments. 



Year 



1974 (n = 2,643^ 
1979(n = 2.494)" 
Chartge 
1974-79 



TABLe 3-4. Percentages of S-YearOlds at Each 
PrimaiV Trait Score Level, ''Puppy Letter"* 





/ Exercise, 1974, 19791 








Non- 
rate- 
abler 
0 


No 
Appeals 

1 


Some 
Appeals 

2 


Score Poinr 
Good 
Appeals 

3 


Unified 
Letter 

4 


Margin- 
*^alor 
Better 

2,3&4 


Compe- 
tent or 
Better 
3*4 


9.3% 
6.3 


31.0% - 
32.1 


44.2% 
46.1 


12.9% 
13.4 


2.6«^ 
2.2 


.' 59.7% 
61.7 


16.6% 
^ 16.6 


'3.0* 


1.0 


1.9 


0.4 


-0.3 . 


2.0 


0.1 



^Statistically significant at the .05 level. 
tPercentages may not total due to rounding error. 



The data indicate that this, too, was a difficult 
tasic for 9-year-olds, only a sixth of whom scored 3 
or 4.' That proportion has not changed from 1974 
to 1979. If level 2 letters kre included, about 60% 
of ihe children^can at least minimally perform the 
task, and that percentage, too, has remained 
stable since 1974. 



Exhibits 3-6 and 3-7 display group patterns for 
this exercise for3 and4 as well as 2, 3 arid 4 level 
papers. Table C-4 in Appendix C presents the dif- 
ferences between jgroiip performance and that of 
the nation/If one exaunines only the ch^ges fo^^ 
■ letters scored 3 and 4, one sees k widening of the 
boy-girl gap from 6 to.9 percentage points; a pre- 
cipitous decline for the not-graduated-from-high- 



EXHIBIT 3-6. Group Changes in Percentages of "Puppy Letter" Papers Rated 3 and 4, 

Primary Trait, Age 9, 1974 to 1979 
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55 

50 
45 

40 

35.:.-' 

30 
25 
20 
15 
XO 
5-- 
J0>- 



EXHfBIT 3-6 (Continued). Group Changes in Percentages of 'Piippy Letter'' Papers 
Rated 3 and 4, Primary Traits Age 9/1974 to 1979 



Parental Education 



PHS 



PHS 
GHS 
NGH 
N 



1974 

21.2% 
15.4 
13.9 
15.5 



—I- PHS 




NGH 



1979 

22.2%' 
14.4 
5.8 
15.6 



. Grade 



1974 

18.4% 

6.8 
15.5 



1979 

18.4% 

8.5 
15.6 



Type of Coimnuniti'* 



AU 



1974 

AU 22.3% 
R 12.1 

DU 7.7 " 
N 15.5 




1979 

24.7% 
3,1 
7.0 

15.6 



The^e population groups represent about one-third of the sample. 
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EXHIBIT 3-7. Group Changes in. Percentages of "Puppy Letter" Papers Rated 2, 3and 4, ' 

. Primary Trait, Age 9; 1974 to 1979 
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EXHIBIT 3-7 (Continueid). Group Changes in Percentages of "Puppy Letter" Papers 
Rated 2, 3 and 4, Primary Trait, Age 9, 1974 to 1979 



: 85 4- 



n 

70 

65 

: / ■. . 

^60 
55 
550 
145 
^40 

bo 

1-0 -L 



These 



Parental Education 



Grade 



Type of Community 



PHS 




NGH 



PHS 
GHS 
NGH 
N 



1974 

71.2% 
61.1 
50.1 
59.7 



NGH 



1979 

69.1% 
64.9 
42.5 
61.7 



1974. 

65.7% 

42.1 

59.7 



population groups represent about one^third of the sample. 



1979 . 

68.4% 

46.1- . 
61.7 



AU 



N ^. 



DU 



19,74 

AU 77.0% 

R 49.0 

.DU 37.4 

N 59.7 



1979 

78.6% 
49.0 
42.5 
'61.7 



--85- 



--80 



-'•65 
--60 
•55 
-h50 

'45 . 

i" 4 0 
-.35 

-t.30 
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school group (from -2 to -10 below thci nation); 
and a decline for the rural youngsters (-3 to -8).. 
The same trends generally hold when score point 2 
letters are included. In contrast to the "Fireflies'* 
narrative task, but similar to the "Goldfish** 
expressive task; disadvantaged-urban students 
showed Uttltr change relative to the nation, re- 
maining about 9 points below the nation for letters 
rated 3 and 4 and about 19 points below the nation 
for letters rated 2, 3 and 4. 

c. Explanatory Writing » 

• Sometimes it is necessary to write letters to 
straighten out a situation or order something 
through the mail in a business context. In addition 
to their other tasks, 9-year-olds were asked to 
order a poster calendar through the mail. Al-^ 
though this exerqise was only given in 1979 and no 
results about changes in performance are avail- 
abler the 1979 results indicate that 9-year-olds 
have considerably less difficulty with more 
straightforward tasks. 

Th? assignment presented students with an ad- 
vertisement for a free poster calendar and asked 



them to request that cakndar, naming which of 
several choices they wanted. (See Appendix A for 
complete exercise and scoring guide.) The writers 
needed to Communicate the information necessary 
to insure receipt of a calendar. Level 1 papers left 
out spmj crucial information like any reference to 
the calendar or only gave an incomplete name and 
address; level 2 papers included this information^ 
but failerl to state a choice; and level 3 papers 
included a name and address and requested a 
particular calendar. There was no score point 4, 
"on the grounds that for 9-year-oIds, a successful 
letter was sufficient. 

Tables 3-5 and 3-6 give the national results for 
the "Poster Calendar" exercise. Results for 
groups are found in Appendix C. About half the 
9-year-olds were able to include all the pertinent' 
information in their letters. When each piece of 
information is looked at separately about three- 
fourths included a greeting and their name, and 
four-fifths made a request and stated their choice. 
The weakest spot seemed to be the writer'i^ 
address: only about three-fifths of the letters 
included one. 



TABLE 3-5. Percentages of 9- Year-Olds at Each Primary Trait 
Score Level, "Poster Calendar" i:xerclse, 1979 



Year 



1979 (ri- 2,492) 



Non- 
rate- 
able 
0 

8.3%. 



Incom- 
plete 

1 

39.3% . 



Score Point 
Ho 
Choice 

2 

3.4% 



Success- 
ful 

3 

48.9% 



Margin- 
al or 

Better 
2&3 

52.3% 



TABLE 3-&. Percentages of 9- Year-Olds Providing 
Various Kinds of Information In 
''Poster Calendar" Exercise, 1979 



Name of sender 
Address of sender 
Make a request 
State choice ^ 



73A%l: 



74.6 
58.3 
87.1 
8Q.2 



Table C-5 in Apt^endix C presents group results. 
The percentage of papers^ rated 3 was '57 for 
girlsj 58% for the post-high-school group and 
66% for the advantaged-urban group. In contrast, 



the percentage for boys was 41%, 20% for black 
yopngsters, 25% for the not-graduated-from- 
high-school group and 27% for those living in dis-. 
advantaged-urban areas. ; * 



B. What Areihe Characteristics of 

the Papers? Descriptions of 
Cohesion, Syntax and iVIechanics 

In addition to being judged for overall (holistic) 
and rhetorical (PTS) quality, some of the papers 
written by 9-year-oIds were further categorized to 
enable a<[» detailed a description as possible of the 
kind of writings -National Assessment collects. 
Some of the cohesion, syntax and mechanics char- 
acteristics described in the following sections un- 
doubtedly relate to the quality of the papers; some 
do not. All of them help us to better understand 
the nature of the papers written by the 9-year-olds, 
the complex interrelationships among various 
writing skills and the stability over time of certain 
features of the papers. 

1. Cohesion 

Cohesive ties are the devices writers use-to-link- 
ideas and give their narratives' coherence. There 
are many kinds of cohesive ties and strategies!. 
Some primary kinds— lexical cohesion, conjunc- 
tion, reference, substitution and ellipsis— are illus- 
trated in Appendix A. In addition to using these 
devices, a writer can try to achieve coherence by 
using rhythm^ repetition,-5toryJranie5,,rjetri)jpec^ 
live summing up and other siich strategies to bind 
parts of the narrative and guide the reader. 
_ Scorers were trained to recognize all these 
approaches and then asked to categorize the 
••Fireflies" papers— the same ones scored for 
primary trait — using the following scoring guide: 

Cohesion Scoring Guide Categories 

1 = Little or no evidence of cohesion: basically 



clauses and sentences are not connected be- 
yond pairings. 

2 = Attempts at cohesion: evidence of gather- 

ing details but little or no evidence that 
these details are meaningfully ordered. In 
other wordjs, very little would seem lost if 
the details were rearranged. 

3 = Cohesion: details are both gathered and or- - 

dered. Cohesion does not necessarily lead 
to coherence, to the successful binding of 
parts so that the sense of the whole dis- 
course is greater than the sense of its parts. 
In pieces of writing that are cohesive rather v 
than coherent, there are large sections of 
details that cohere but these sections stand 
apart fl5 sections. ' 

4 = Coherence: while there may be a sense of 

sections within the piece of writing, the 
sheer number and vainety of cohesion strat- 
egies bind the details and sections into a 
wholeness. This sense of wholeness can be 
achieved by a saturation of syntactic repe- 
tition throughout the piece and/or by clo- 
sure that retrospectively orders the entire 
piece and/or by general statements that or- 
ganize the^hole piecer^-^ z~ 



o Table 3-7- displays-therpercentagerof-papers in — 
each cohesion category on the •Tireflies" exercise 
for 1970, 1974 and 1979. Results for 2, 3 and 4 
combined are not presented because level 2 papers 
are^not really cohesive. As the bottom line in the , 
table indicates, there was little difference between 
the results for 1970 and those for 1979. The pro- 
portion of cohesive papers (3 and 4) went from 
22Vq to 26<7o and down again to 22<7o. 



TABLE 3-7. Percentages of 9- Year-Olds at Each 
Cohesion Score Level, "Fireflies" Exercise, 1970, 1974, 1979t 

Year Score Point 





Mar. 

nun- 


Inade* 


AliempiS 


Cohesion 


Cohesion 


Cohesion 




rate- 


quate 


at 




and 


or 




able 




Cohesion 




Coherence 


Better 




0 


•1 


2 


3 


4 


3ai4 


1970 (n = 2,466) 


5.4% 


29.1% 


43.1% 


20.3% 


2.0%, 


22.3% 


1974 (n = 2.573) 


^ 4.3 


24.8 


45.4 


23.8 


1.7 


25.5 


1979 (n = 2,553) 


3.3 


28.8 


46.0 


20.9 


1.0 


21.9 


Change 














1970-74 


-1.2* 


-4.3* 


2.3 


3.4 


'6.3 


3.1 


1974-79 


-1.0 


4.0* 


0.6 


. -2.9 


•0.7 


•3.6 


1970-79 


-2.0* 


•0.3 


2.9 


0.5 


•1.0* 


-0.5 



^Statistically significant at the .05 level. 
tPercentages may not total due to rounding error. 



The cohesion results parallel the. trend for the 
PTS ratings for marginal or better papers noted in 
Table 3-2, Although substantially fewer papers 
_(22-26<l^(> compared with 63-74%) were judged co- 
hesive, both ratings indicated an improvement 
between the first two assessments with a decline in 
the third back toward the original percentages. 

Exhibit 3-8 displays group patterns and Table 
C-2 in Appendix C presents specific differences 
for groups. Several interesting points emerge from 
these data. First, the- percentage of black 
youngsters receiving scores of 3 or 4 rose steadily 
from assessment to assessment, with the result 
that the blacks gained ground, halving their rela- 
tive difference from the national level. 

Second, the disadvantaged-urban group also 
improved from assessment to assessment, cutting 
its difference from more than 16 points below the 
nation to 7 points below. . 

Third, the Southeastern group improved while 
the nation stayed the same, so its relative position 
changed from 7 points to only 2 points below the. 
liafiorirThe Northeast declmed lbsing"ff sTel-^ 
ative advantage. • ^ 

t« 

Fourth,^ rural students improved dramatically 



(21*!^o) from the first assessment to th^ second. 
Although they declined in the third assessment, 
they still showed a \4% improvement for the 
nine years, which changed their relative standing 
from 13 points below the nation in 1970 to 2 
points above it in 1 979. 

Fifth, the difference between the percentages 
for boys and girls increased from 6 to 8 points so 
that in 1979, girls performed significantly above 
the nation and boys significantly below. 



To gain additional information about changes 
in coherence, the "Kangaroo" papers', were 
subjected to a different and jess refined, but re- 
lated analyst. Using a procedure developed for 
previous assessments, readers . categorized para- 
graphs as coherent and incoherent. Table 3-8 dis- 
plays the results of this process for all papers, as 
well as for poor papers (rated 1 and 2 on the hol- 
istic scald) and good papers (rated 3, or 4). The 
table reveals several things. First, in all three as- 
sessments there was a significant difference 
between good and poor papers in terms of their 
"proporrionr^ of Tohe^ 

this difference increased somewhat in 1974, by 
1979 it had decreased back to the original 36,Vo 
evidenced in 1970. 
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EXHIBIT 3^8. Group Changes in Percentages of "Fireffies" Papers Rated 3 and 4, 
Cohesion, Age 9, 1970 to 1974 and 1974 to 1979 
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EXHIBIT 3-8 (Continued). Group Changes In Percentages of "Fireflies" Papers Rated 3 and 4, 

Cohesion, Age 9, 1970 to 1974 and 1974 to 1979 
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Nation 
Poor(1&2) 
! Good'O & 4) 



TABLE 3-8. Average Percentages of Coherent 
Paragraphs, Good and Poor ''Kangaroo" Papers, 
Age9,1970,1974,1979t 



1970 
(n = 384) 

56.9% 

40.8 

77.4 



1974 
(n = 409) 

42.5% 
20.5 
69.3 . 



1979 
(n = 494) 

71.9% 

53.9 

89.6 



'Statistically significant at the .05 level. 
tPercentages may not total due to rounding error. 



Change 
1970-74 

-14.4%* 
20.3* 
- 8.1 



Change 
1974-79 

29.5%* 

33.4* 

20.3* 



Change 
1970-79 

15.0%* 

13.1* 

12.2* 



Second, in contrast to the "Fireflies" exercise 
where few changes occurred in the percentage of 
coherent papers, with the "Kangaroo" papers 
there was a significant decline in the percentage of 
coherent paragraphs (particularly for poor papers) 
between 1970 and 1974. This was followed by a 
dramatic improvement in 1979. fn 1979, almost 
three-fourths of the parkgraphs were judged to be 
coherent; Although both good and poor papers 
improved, the poor papers improved the nfiost, 
more than canceling out the earlier declines. From 
.1970 to 1979, the overall improvements were uni- 
form for good and poor writers. 

2. Syntax 

Both the "Fireflies" and "Kangaroo" papers 
were examined to see if there were any changes 
over-theTiine-years-in-the~numbeFS^nd-typesH>f — 
sentences in the papers. 

Table 3-9 displays some characteristics, 
including length and proportions of sentence 
types, of the "Fireflies" and "Kangaroo" papers. 
Several points stand out. First, "not much has 
changed over the decade. The papers were roughly 
the same kngth, although the "Fireflies" 
narratives grew one sentence shorter .while the 
"Kangaroo" papers became one sentence longer. 
Average word length, four letters, was identical 
forboth sets of papers in the different years. Also, - 
both employed roughly the same proportions of 
simple (46-50%), compound (5-11 %) and complex 
(28-21%) sentences. The "Kangaroo" papers did 
contain more sentences with phrases. The re- 
mainder of the sentences in both papers (about 20- 
22%) were run-on sentences and fragments. 
These, along with other errors such as awkward- ^ 



ness, spelling and word-choice, are discussed 
shortly under mechanics. 

Second, averages can be deceptive. Notice, for 
example, that in the 1979 "Fireflies" papers the 
average percent of complex sentences, was 21%, 
but half the papers had none at all! 

And, third, the papers were very short— half the 
"Fireflies" papers consisted of only three or fewer 
sentences. Still, the figures discussed here cannot 
tell us much about quality. They are useful 
primarily for describing the great range and 
variety in the papers and the relative stability of 
such distributions and proportions across time for 
particular writing tasks. 

Table 3-lOdisplays occurrences of various kinds 

of^mbedding and modification-in-the-i!EirfillieslL 

papers^Table 3-10 uses terms that are perhaps less, 
familiar to general readers. Most research on 
syntax or sentence forms is done in. terms of the 
"T-unit," instead of the sehtence, in order to 
examine the amount and kind of modification and. 
embellishment writers use. Subordination skills— 
the processes by which writers embed information 
in their sentences— have been shown to develop in 
writers as they mature, enabling older and better 
writers to convey more information more ef- 
ficiently. Syntax analysts useCthe T-unit — an in- 
— -dependent clause-^nd-all its modifying words, 
phrases and clauses — because it enables them to 
focus upon embedding more precisely than, the 
sentence. This approach takes into account subor- 
dination and coordination between words, phrases 
and subordinate clauses. It doe^ not take into 
account coordination between main clauses-^^the 
tendency to string T-units together rather tlTi|;i 



TABLE 3r9. Means and Percentiles for Characteristics of Two 
Narrative Papers, Age 9, 1970, 1974, 1979t 



Nean 



1970 
Ql Nedlan 



Q3 90th 



Nean 



1974 
Ql Median 



Q3 90th 



Nean 



1979 
Ql Hedlan 



Q3 90th 



:l sentences/essay 
'I words/essay 
fAvg. # words/sentence 
7Avg. # letters/word 

minor sentences 
yt simple sentences 
^% compound sentences 
I X complex sentences 
^X simple sentences with 
k phrases 

;iX .complex sentences with 
phrases 

Kumber of respondents 



















"Fireflies" 


5 


2 


3 


6 


8 


5 


2 


4 


6 10 


47 


21 


35 


58 


85 


56 


29 


47 


72 : 100 


13 


8 


10 


14 


22 


16 


8 


12 


18- 29 


4 


4 


4 


4 


4 


4 


4 


v4 


4 4 


0 


0 


0 


0 


0 


0 




' 0 


0 0 


55 


33 


57 


86 


100 


48 


^^ 


50 


75 100- 


6 


0 


0 


- 0 


25 


9 


0 


0 


0 27 


20 


0 


0 


33 


50 


20 


0 


0 


33 50 


13 


0 


0 


20. 


. 43 


12 


0 


0 


18 43 


7 


0 


0 


0 


19 


5:^ 


c' 


0 


0 25 






556" 










584 





4 


2 


3 


6 


9 


50 


23 


42 


75 


112 


15 • 


8 


11 


18 


31 


4 


4 


4 


4 


4 


0 


0 


0 


0 


. 0 


50 


17 


50 


78 


100 


11 


0 


0 


0 


33 


21 


0 


0 


33 


57 


13 


0 


6 


20 


46 


8 


0 


0 


0 


25 






596 







-0.3^ 
3.6 : 
2.7* : 
0.0 . . 

-0.1 . 

-5.6*> 
4.2* 
0.7. 

-0.2 J 

0.9 



"Kangaroo" 



^# sentences/essay 
^'1 words /ess ay 
CAvg. # words/sentence 
kAvg.,i lettfers/word 
■ft minor sentences 
|!X simple sentences 
^1 compound sentences 
|l complex sentences 
|X simple sentences with 
# phrases 

i'X c(kp1 ex sentences with 
phrases 

Number of respondents 

' " I' ' 

k^Statiaticaliy eignificant at the .OS level. >> 

t^Figures foT meana and percentilea have been rounded to the neareat whole number. 



' 4 


2 .' 


3 


5 


8 


5 


2 


4 


6 


9 


5 


2 


4 


6 


9 


45 


25 


37 


60 


83 


54 


31 


46 


71 


96 


56 


30 


47 


74 


98 


14 


8 


11 


15 


'24 


15 


8 


11 


16 


27 


15 


8 


11 


17 


25 


4 


4 


4 


. 4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


4 


0 


0 


0 


0 


. 0 


-0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


46 


15 


50 


71 


100 


43 


17 


44 


67 


86 


46 


17 


50 


67 


100 


6 


0 


0 


0 


20 


6 


0 


0 


0 


25 


5 


0 


. 0 


0 


24 


26 


0 


20 


42 


67 


27 


0 


20 


43 


67 


• 28 


0 


20 


50 


67 


36 


0 


33 


50 


75 


29 


0 


29 . 


50 


67 


' 33 


0 


33 


50 


67 


21 


0 


0 


33 


50 


21 


0 


14 


33 


60 


23 


0 




33 


- 67 




t 


384 










409 










494 







0.8*.; 

10.8*li 

o^g ; 

-0.0 -} 

-0.2 : 

-0.3 
-1.4 ■ 
1.6 



2.1 
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TABLE 3-10. Means and Percentiles for Number of T- 
T-Unit Constituents, Narrative Papers, Age 9, 1970, 



Units and 
1974, 1979t 



Iji.iT-unlts/essay 

;i*yg. I words/T-unit 

y^ySffr # subordinations (embed- 

p<nng)/T-unit 

|AV9r .# subordinate clauses/ 

il^unn : . 

:^yg. # words/clause 

^ Ayg • ; # nomi na 1 i za 1 1 o nsy T- u n 1 1 

tAvg. r adjectival (noun) modl- 

p,ficat1ons/T-un1t 

# relative clauses/ 
T-unIt ' ' 
Avg. # adject1ves/T-un1t 
: Ayg . # adverb 1 a 1 mod 1 f 1 ca 1 1 ons / 
feT-unlt . 

L*^gt # Intra- T- unit coordlria- 

>ii^;Ttions/T-un1t 

{Ayg. # subordinations and Intra- 
Tr unl t coordi na t1 ons/T-unI t 

: Number of respondents 



556 



Mean"^ 01 


1970 
Median 


90th 


Mean 


Ql 


1974 
Median 


Q3 


90th ^ 


Mean 


5.5 

9;2 


2.0 
6.9 


4.0 
8.2 


7.0 10.0 
iO'.y 13.3 


6.4 
10.0 


3.0 
7.2 


5.0 
8.8 


8.0 
11.3 


12.0 
14.5 


5.4 
10.4 


1.0 


' 0.5 


0.9 . 


1.3 


2.0 


1.0 


0.5 


0.9 


1.3 


2.0 


1.1 


0.2 
7.0 
0.2 


0.0 
5.4 

' 0.0 


0.1 
6.5 
.0.1 ■ 


0.4 
7.9 
0.3 


0.7 
10.2 
0.6 


0.3 
7.6 
0.2 


0.0 
5.6 
0.0 


0.2 
6.8 
0.1 


0.4 
8.2 
0.3 


0.7 V 
10.3 
0.5 


0.3 
7.4 
0.3 


0.6 


0.3 


0.5 


1.0 


l.J 


0.6 


0.3 


0.5 


0.9 


1.3 


0.7 


0.1 
0.2 


0.0 
0.0 


0.0. 
0.1 


0.1 
0.4 


0.3 
0.7 


0.1 
0.2 


0.0 
0.0 


0.0 
0.1 


0.2 
0.3 


0.3 
0.6 


0.1 
0.2 


0.1 


0.0 


0.0 


1.2 


0.3 


0.2 


0.0 


0.0 


0.2 


0.5 


0.2 


0.3 


0.0 


0.1 


0.4 


1.0 


.0.4 


0.0 


0.2 


0.5 


1.0* 


" 0.5 


1.2 


0.6 


1.0 


>.5 


2.3 


1.3 


0.6 


1.0 


1.6 


2.3 


1.4 



584 



\*Stati8tioally .eignifiaant at the ,0$ level, 

^Figuree for meane and percentiles have been rounded to the nearest tenth. 



Ql 


1979 
Median 


Q3 


90th 


' Mean - 
Change ' 
1970-7^ 


2.0 

7:5 


4.0 
9.1 


8.0 
11.8 


12.0 
15.5 


-o.os;: 

\.Vi 


0.5 


1.0 


1.4 


2.0 


0,14* 


0.0 
5.6 
0.0 


0.2 
6.7 
0.1 


0.4 0.8 
8.5 11.0 
0.3 0.7 


0.031 
0.40* 
0.08 ; 


0.3 


0.5 . 


1.0 


1.3 


0.03 : 


0.0 
0.0 


0.0 
0.1 


0.2 
0.4 


0.3 . 
0.7 ■ 


0.04* 

-0.01;; 


0.0 


0.0 


0.2 


0.5 


" 0.62! 


0.0 


0.2 


0.5 


1.0 


0.16^ 


0.7 


1.1 

" 596 


1.8 


2.8 


0.25^ 
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embjed information. The table tells us that, in 
1979, the average narrative paper contained about 
five and one-half T-units or separate subject-verb 
constructions or statements. This is more than the 
number of sentences (4.2), which indicates that 
some of the senten vere compound or run-ons 
(strings of independent clauses). 

The first point to note from Table 3-10 is that 
the average number pf words per T-unit, the 
average number of words per clause, the average 
number of subordinations arid intra-T-unit co- 
ordinations—all indicators of syntactic 
maturit)'— have increased slightly over the nine 
years. The second point is that the avierage number 
of subordinations and intra-T-unit coordinations, 
1.4, tells us that in each T-unit there was em- 
bedded one or maybe two pieces of information 
that were not part of the basic (kernel) subject- 
verb predication . This was primarily done through 
^ subordination (1 .1). There are two ways to look at 
the subordination: in terms of the units used 
(clauses, phrases or words) and in terms of the 
way those units function (as nouns, adjectives or 
adverbs). The table indicates that the functions 
were primarily adjectival. There were very few 
nominalizations (.3) and adverbial modifications 
X.2), compared with adjectival constructions (.7). 
The units were some clauses (.3), with the re- 
mainder being phrases (.4) and words (.4). 

Although these numbers ma y, mean mo re t o _ 
linguists than to the general reader, the important 
information in Table 3-10 is highlighted below: , 



• The average paper is rather perfunctory, link- 
ing subjects, verbs and objects without much 
mqdification or elaboration. 

• There have been some increases in measures 
of syntactic ability from 1970 to 1979, in- 
dicating that 9-year-olds are embedding 
slightly more infbrmation in their sentences 

\ than they used to. > 

An extensive report on the full syntactic analysis 



of these papers will appear at a later dateT 
3. Mechanics 
As this report illustrates, the consultants who 



helped develop the national writing assessments 
do not believe mechanics and error counts are the 
only or the most important aspects of writing that 
should be evaluated. Errors may be indicators of 
unlearned skills, but they may aiso be indicators 
of growth. By themselves, errors do not tell us 
much; in the context of a particular papery 
partUfalar pattern and a particular student, they 
have great diagnostic value. When we gather error 
counts from hundreds of papers and organize 
them abstractly into tables such as those in this, 
chapter, we are using them in a purely descriptive 
way. We are less interested in the counts per se 
than in the ^)atterns they suggest and the changes 
they undergo over the years. 

Table 3-11 presents mean error counts for two 
narrative tasks (the "Kangaroo*^and 'Tireflies** - 
papers discussed earlier). The main point that can 
be "observed from these tables is that really very 
little has changed from 1970 to 1979. However, it 
appears that the error counts increased between 
the first and second assessments, then decreased 
between the second arid third. Looking at each 
type of error across the nine ye^irs, it appears that 
increased fragments in the ''Fireflies** exercise 
were countered by decreased run-ons and word- 
choice errors. A decline in the percentage of awk- 
ward sentences appeared for the ''Kangaroo** 
papers. ' 

1 — A-second-point is that one out of every four or 
five sentences was judged awkward. When these 
sentences were further :anailyzed„for_the^'Firer„ 
flies** narrative, it appeared that most of them 
were a result of carelessness — leaving a word out, 
and so on. 

A third point is that the error counts seemed 
quite consistent across tasks, which is to be 
expected,. considering both exercises required nar- 
ratives. Looking at the 1979 figures, one sees that 
in both, the average percentage of fragments is 6- 
l^tii the percentage of run-on sentences is around 
14%, the percentage of misspelled words is .9- 
liyp, the percentage nf sentences wirh ag reement 



errors is 8-9% and the number of punctuation 
errors is between one and two. The punctuation 
error was slightly more likely to be a comma error 
thnn an endmark error, prqbably of omission. 
Both sets of papers were relatively free of cap- 
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TABLE 3-iL 



Average Frequency and Changes in Average Frequency of Errors 
in Two Narrative Papers, Age 9, 1970, 1974, 1979t 



1570 
Avg. # Avg. % 



1974 
Avg. # Avg. % 



1979 
Avg. # Avg. 



Change 1970-74 
Avg. # Avg. % 



Change 1974-79 
Avg. # Avg. % 



."Fireflies" 



Sintehce* fragments 


0.2 


.3.6 


! 0.3 


4.7 


0.3 


6.1 


0.1* 


1.1 


0.0 


1.4 


0.1* 


2.5' 


ftufv^on sentences .. 


0.4 


14.3 


0.5 


17.4 


0.4 


13,8 


0.2* 


3.0 


-0.2* 


-3.7 


.0,0 


-016 


febi.ard sentence? 


0.9 


27.1 


1.1 


30.0 


0.8 


27.9 


0.2* 


2.8 


-0.3* 


-2.1 


-0.1 


0.7 


S^faulty parallelism 


0.1 


3.7 


0.1 


3.8 


0.1 


3.7 


-0.0 


0.1 


-0.0 


-0.1 


-0,0 


-0.0 


iUnclear pronoun reference 


0.1 


1.5 


0.1 


2.6 


0.0 


0.9 


0.1* 


1.1 


-oa* 


-1.7* 


-0.0 


-0.6 


pllloglcal constructions 


0.1 


• 2.3 


0.1 


2.6 


0.0 


0,6 


0,0 


0.4 


-0.1* 


-2.0* 


-0.1* 


-1.6^ 


liother (dysfunctional constructions 


0.6 


19 7 


0.8 


21.0 


0.7 


22.7 


0.2* 


1.3 t 


-0.1 


\ 1.7 


0.1 


2.9 


Capitalization errors 


0.3 




0.7 




0.5 




0.4* ' 




-0.2 




0.2* 




Misspelled words 


3.7 


10.2 


5.0 


10.5 


4.3 


10.8 


1.3* 


0,3 


-0.7* 


0.3 


0.6 


0.6 


ibird- choice errors » 


0.4 


. 1.1 


0.5 


l.G 


0.4 


0.8 


0.2* 


-0.1 


-0.2* 


-0.2 


-0.0 


-0.3< 


Sentences with agreement errors 


0.2 


6.0 


0.3 


7.1 


0.2 


8.4 


0.1 


1,1 


-0.1 


1.3 


0.0 


2.4; 


fotal punctuation errors 


1.8 




• 2.7 




1.9 




0.9* 




-0.7* 




0.2 




IfConna errors 


0.7 




0.9 




0.7 




0.3* 




-0.2 




0.0 




f;Endraark errors 


0.4 


16.5 


0.5 


15.9 


0.4 


14.1 


0.1 


-0.6 


-0.1 


-1.9 


-0.0 


-2:5 


£ Number of respondents ? 




556 




584 




596 




















y 






"Kangaroo" . 












Sentence fragments ■/ 


0.3 


6.9. 


0.3 


5.9 


0.4 


7.0 


0.1 


-1,0 


0.0 


<. 1.0 


\ 


0.1 


^un-on sentences 


0.4 


14.3 


0.5 


18,5 


0.5 


14.6 . 


0,1* 


4.2 


-0.0 


-3.9 




.0.3 


^kward isentences 


. 0.7 


24.5 


0.8 


^ 19.7 


0,7 


18.7 


0.1 


-4.8 


-0.1 


-1.0 


-0.0 


-5.8^ 


iapitalization errors 


0.6 




0.8 




0,7 




0.2 




-0.1 




0.1 




lisspelled words 


3.5 


8.6 


4.2 


8.6 


4.3 


9.0 


0,7^' 


-0.1 


0.1 


0.4 


0.8* 


0.4 


ijbrd- choice errors 


0.4 


0.9 


0.5 


i : i 


0.4 


0.8 


0.1 


0.2 


-0.1 


-0.2 


-0.0 


-o.i, 


Sentences with agreement errors 


0.4 


12.0 


o;5 


13.7 


0.4 


9.2 


0.1 


1,7 


-0,1 


' -4.5* 


-0.0 


-2.8 


rptal punctuation errors 


0.9 




1.3 




1.2 




0.4 




-0,1 




0.3* 




(ICipiBna errors 


-0.4 




0.4 




0.6 




-0,0 




0.2 




0.1 




1 Ehdmark errors 


0.^ 


13.9 


0.6 


15.8 


0.4 


14"5" 


0.3" 


^9 ^ 


-0.2 


-1.3 


0,1 


0.6 



^^^J Number of respondents* 

^SiahUticalty significant at the *0S level* 
tFignriea may not total due to rounding error* 




384 



409 



494 



51 
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italization errors and word-choice errors. How- 
ever, the **Fireflies" papers contained a greater 
percentage of awkward constructions— -28% com- 
pared with 19% for the "Kangaroo'* papers. 

Since the numbers in Table 3-11 are averages 
and no single paper could be expected to contain 
tho^e exact features, Table 3-12 offers another 
view of errors by presenting the values of their dis- 
trihiutibns at the first quartile (25% made this 
many or fewer errors and 75% made this many 
errors or more), the median (half made this many 
or fewer errors and half made this many errors or 
moire), the third quartile (75% made this many or 
fewer errprs and 25% made this mapy errors or 
more) and the 90th percentile (the most error- 
prone 10% of the students made at least this many 
errors). Notice that with the exception of three or 
four misspelled words and an awkward construc- 
tion (probably due to carelessness), 50% of the 
student3ivrote largely error-free papers. However, 
it appears that about 25% of the students did 
commit some errors in almost every category, and 
10% displayed severe writing problems. Writing 
skills— at least in terms of ^rror counts— do not 
seer> to distribute themselves smoothly over a 
"bell shaped' V curve; Rather, they are distributed 
in heavily skewed shapes that suggest two very dif- 
ferent populations of people. One of those pop- 
ulations—the majority— appears to have a 
general, though imperfect, grasp of written 
language. The other population appears Jo-be„vir!r_ 
tuallylost. ^ 

Tables D- l and D-2jn Appendix D.display error 
counts for good and poor writers' (defined by hol- 
istic, primary trait and cohesion ratings). Poor 
writers created many more fragments, awkward 
sentences, misspelled virords and agreement errors 

f than did good writers. Except fdr fragments, poor 
writ5P«<3o not seem to have many more problems 
with punctuation than good writers. It does 
appear that while poor writers may have the 
tenderi;;:^y~ to end sentences prematurely 

, (fragments), good writers tend not to end them 
soon enough (ruh-ons)/Ahhpugh several spiecific 
features changed for one task or the other (poor 
writers may be making more spellihg errors while 
good writers are making fewer)* w 
remained generally stable between 1 970 and i 979 
for both good and poor writers. 



42 



Table 0-3 shows error counts for males, 
females, blacks and whites. Males tended to make 
more inechanical errors in most categories than did 
females. Little seems to have changed from 1970 
to 1979 concerning this difference. Blacks, too, 
made more errors th^n the rest of the national 
population. The differences were If rgest in the 
areas of awkward constructions and agreement 
errors, which may be a sign of bidialectal inter-> 

ference in their writing. 

• ■ ■ . m 

_, . _ . s 

Looking back over the tables containing the 
mechanics results; the major point they seem to 
make is that the numbers have generally remained 
stable through the i970s. This suggests that 
perhaps a certain percentage of error will always 
remain as a stable feature of writing, and especial- 
ly first-draft writing.' 



C. Attitudes Toward Writing 

In 1979, 9-year-olds were asked to respond to a 
\series of stiatements about themselves as writers. 
Table 3-13 displays the statements and the per- 
centages of students expressing degrees of agree- 
ment or disagreement. In general, statements re- 
flecting positive attitudes toward writing received 
the assent 6f half to two-thirds of the 9-year-oids. 
Statements reflecting nepative attitudes were 
agreed to (strongly or otherwise) by about a fifth 
_tp-alfourth-ol4heJstudcnts.^lly_two4hirds^^ 
they enjoy writing and. write for other reasons 
besides school. And a like proportion- indicated- 
they had positive attitudesr on at least half the 
statements. These results indicate that at this early 
age there isi'a reservoir of goodwill toward writing 
ready to be tapped. But they also indicate t 
eyen at age 9 th&e is a hard core of 20-25% who • 
are fearful about writing, have a sense of doom 
about it and avoid the activity whenever they can. 
Tfte evidence in the other two volumes of this 
report suggest that this group of unconfident and 
pessimistic writers does not go away at the higher 
ages. If anything, it only hardens and grows some- 
what larger. We do hot know Wh 17-year!5 
olds who express nlegative attitudes would also 
have done so at ages 13 and 9 or whetfier the pool , 
of unconfident writers changes as sbme.move out\ 
and others fall in . The bjsst guies^^hat ,some^' 
peb^move in and out of the hard core and many 
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TABLE 3-12. Means and Percentiles for Errors in Two Narrative 
Papers, Age 9, 1970, 1974, 1979t 









1970 










1974 










1979 






• ■ 


Meai 


Ql 


H^dlan 


Q3 


90 th 


Nean 


Ql 


Median 03 


90th 


' . Mean 


Ql 


Median 


Q3 








■ \ 










•v 


"Fireflies" 










(^sentence fragments 


.4. 


0 


0 


0 


1/ 


5 


0 


0 


0 


20 


6 


0 


0 


0 


29 


[ run-on sentences 


* 14 


, 0 


Q 


14 


50 


17 


0 


0 


25 


100 


14 


0 


0 


17 


52 


(-awkward sentences 


27 


0 


20 


50 


100 


30 • 


0 


25 


50 


100 


28 


0 


20 


50 


100 


f capitalization errors 


0 


0 


0 


0 


1 


1 


0 


0 


1 


2 


1 


' 0 


0 


1 


2 


(^Misspelled words 


10 


4 


' 7 


14 


22 . 


10 


4 


8 


14 


23 


11 


' 3 


8 


i2r 


24 


t^word- choice errors 


1 


0 


0 


1 


4 : 


1 


0 


0 


2 


4 


1 


0 


0 


1 


3 


sentences with agreement errors 


6 


e 


0 


0 


33 


7 


0 


0 


0 


33 


8 


0 


0 


0 


50 


h total punctuation errors 


Z 


0 


1 


2 


. 4 


3 


0 


1 


3 


7 


2 


0 


1 


3 


6 


Number of respondents 






556 






t, 




584 










596 










» ; 






i 


J. 






"Kangaroo" 












(rsentence fragments 


7 


Oi 


0 


C 


33 


6 


0 


0 


0 


25 


7 


0 


0 


0 


25 


t?run-0Q sentences 


14 . 


0 


0- 


19 


SO 


18. 


0 


0 


25 


100 


15 


0 


• 0 


25 


. 50 


t awkward sentences „ . 


24 


0 


12 


40 


100 


20 


0 


0 


33 


67 


.19 


0 


' 0 


33' 


50 


IxApltallzatlon errors 


1 


0 


0 


1 


.2 


1 


0 


0 


1 


2 


1 


0 


0 


1 


2 


(imrsspelled words 


9 


3 


7 


13 


19 


9 


2 


6 


12 


19 


9 


3 




13 


20 


word-cho ) ce erro rs 


1 


' 0 


0 


1 


3 


1 


0 


0 


. 1 


4 


r 


0 


o' 


1 


2 


sentences with agreement errors 


12 


0 


0 " 


14 


50 


14 


0 


0 


17 


50 


9 


0 


0 


13 


33 


^: total punctuation errors 


" 1 


0 


0 


1 


2 


1 ' 


0 


1 c 


1 


3 




0 


- 1 


2 


3 


Number of respondents 






384 










409 










493 






^Statiatically aignifiaant at the 


OS level. 






























tHgurea for means and percentilea 


have been rounded to 
t 


the 


nearest whole- mmber. 
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■ 1 
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J 1 
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TABLE 3-13. National Percentages of Responses to Attitude 
\ . Questions About Writing, Age 9, 1979'v - 



On this and on the. next page are statenients about wr iting. There are no right 
or wrong answers to these statements. Please indicate how much you agree or 
disagree' with each ^aitement by filling in the oval under the appropriate 
response,. While sonl^'e of the statemehts' majf seem repetitious, take your iime 
and try to be as honest as possible. 



Strorigly Strongly 
Agree Agree Uncertain Disagree Disagree 



I like to write 
down my ideas. 



20.4 41.1 ' 
\ / 
61.5 



14 . 0 



16.3. 7.9 
\ ' / 
24. 2 



B. I am no good at 
writing. 



11.9 „ 15.2 15.'7 ~- , 28. 7 - ,27.8 

\ / • \ / . 

27r.l - 56.5 - V 



•5»^ ■ 



C. Expre^ingideas : ii^^4 13^6 ^^^^ ^ 29.4 ' 28^0- 

• through writing v / ^y.'* i^p. u 

' * seems to be a ; ok n ' * '\ ct » > 

wasteof time.; > . I ' : " v, ^7. 4 



D. / People seem to 
enjoy what I 
write. 



16.5 28.7 29.6 14.0 ' 10.8 

■■■■\- ■■/ ■ ■ ■ ■ . \ - . .-*V - ••/ ■. ■ ! 

45.2 .24:8 • ■ 1 



E. I exj)ect to do 
poorly in 
composition 
classes before 
I take them. 



9.9 12.1 

\ ./ 
21.9^ 



20; 7 



26.3 30. 

\"^- / 
56.6 



I look forward 
to writing down 
my ideas. 



26.2 -29.8 
\ 7 
5-6 . 1 



15.-7 



14.2 ■ ^3.6 

A ' 
, 27: 8 



TABLE 3'-l3 (Continued).^ National Percentages of Responses to Attitude 
Questions About Writing, Age 9, 1979^ 



Strongly ' Strongly 

Agree Agree Uncertain Disagree Disagree 



G. 


I write for other 
reasons besides 
school. ' 


32^7 4 36.0 

A / ^ 
68,7 


12.3 


10 1 8 4 

\ / 

18. 5 , 


H. 


When J hand in a ; 
composition, I 
know I'm going 
tq do poorly. 


^^5: 10.5 

- A / 

as.o 


26.2^ 


28.5 25.9 
\ / 
54.3 


l' 


I enjoy writing. 


33.8 31.9 
65.7 


9.6 


10.5 ' 12.4 
\ / 
22.9 


J. 


I am afraid of 
wViting es5ays^ 
when I know thjey 
: will be evaluiated. 


?.3 14.9 

24 1 


37.4 


20.1 - 17; 1 
\ / 

■ * ■ 


K. 


I feel^con-fident 
in njy ability to 
clearly express 
' my idea's in 
writing. 


24: r 31.2 

\ / 

55.6 


23.2 


11*7. 8.7 

V / 
20.3 


L. 


avoid writing. 


9.3 10.6 
\ / 
19. ^< 


' 12. 8 


24. 2 42. 6 

\ ./ • 
66.8 



"^^Peraentages rrkjy not add to 100%' due. to nonres^onse. Also^ percentages for 
stPorCgly agree^ and agree or disagree and strongly disagree^ may not add to 
total agreement or disagreemewB. due to rounding. 



Percentage of Respondents Giving a Positivie Response 
to 12 Attitude Questions 



At 


least 1 


99.6% 


At least 7 


55.2% 


At 


least 2 


98.3 


At least 8; 


41.6 


At 


least 3 


95.2 


At least 9 


28.1 


At 


1 feast 4 


89.3 


At least 10 


16.3 


At 


least 5 


80.2. 


At least 11 


7.4. 


At 


least 6 


68.6 


All 12 


/ 1.7 



Adapted fpom a quBBtiormaiTe^ **Ea0 I Feel Abou\ Writing,'* developed by 
Riahard )i. Boeeone and.Lym Quitman Troykai The City ^Univereity of Neuf 
York. .r-^ . 



remaifl injlthrpughQUt their s^^^ If this po sitive attitu des t oward writing must begin prior 

is true, then it appears that the inculcation of to the third grade. ^ 
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CHAPTER 4 

AN OVERVIEW OF THE WRITING OF 9- YEAR-OLDS, 
13-YEAR-OLDS AND 17 YEAR-OLDS , 



This volume presents Writing^assessment results 
for a single age group; parallel results for the other 
two age groups appear in the other two volumes of 
the report. However, in order to put the results in 
this volume into perspective, it is useful to look' at 
general resufts for alFthree ages. 



On holistic ratings, the 17-yearrolds do not 
show a statistically significant change over the 
Occade for a descriptive task. There are some 
signs, however, that the average quality of their 
writing is somewhat: lower than it was. The 13- 



year-olds display a siginfficam"lle^ 
tive writing, though it appears that much of it 
took place between the first two assessments and 
the quality has stayed about the same since then. 
The 9-year-plds do not show a statistically 
significant' change on a narr^tiye tasfcgKbut there 
are indications that the. overall quality of their 
work has improved withf each assessment. These 
holistic fesuits suggest two things. First, since 
changes in overall writing quality are basically 
undratnatic fqr any particular age group, realizing 
changes in such a complex skill may be a slow 
process'. It may take man y more ^assessments to 
establish the impact of educational instruction on 
writing performance. Second, what one says 
about th|?^ situation of writing in America depends 
upon which level of the educational system one is 
interested in. The differing trends in the data 
suggest that primary school, junior! high school 
and high school constitute somewhat separate 
targets for policy action in the ^rea of writing. 
Generalizations from one age to another appear to 
be inappropriate. 

The results for writing tasks calling for different 
types of rhetorical or communicative approaches 
provide further cause for caution in making global 
comments about writing* At ages .17 and 13. 
expressive writing skills are improving or 



remaining at the same level, while persuasive and 
descriptive writing skills appear to be declining. At 
age 9, there have been ups and downs in expressive 
writing, defending on the task, but persuasive 
writing skills appear stable. / 

't ■ ■ 

Error analysis does not reveal many major 
changes in the commission of certain errors Wera" 
decade's time a^ any age. Awkwardness seems to 
fluctuate a bit from assessment to assessment, as 
do punctuation and spelling errors. But tfie range 
of fluctuation seems small and the data suggest 
~tira!~aFeach age there will always be errors in 
writing of this kind. Even more stable than th^ 
error' proportions are the results of syntactic 
analysis. The embedding rates snd various indices 
of subordination and coordination remained 
identical or very similar at ages 13 and 17 from 
assessment to assessment. This is largely_so2at:age_ 
9, but some indicators do reflect a bit of growth 
over the decade, n 



Although all three-age-groups-did-not-per^drm 
the same writing tasks, it is clear that more 13- 
year»:olds demonstrated writing skill than 9-year- 
:olds and. more 17-year-olds did than l3-year-oIcls. 
There is progress from age to age and from grade 
to grade. . . ^ - ^ 

On the other hand, eryoyment of writing seems 
to decline front age to 'ajge. Two-thirds of the 9- 
year-olds said they enjoy writing, compared to 
59% of the 13-year-olds and 53% of the 17- year- 
olds. 

Group results and changes in them were quite 
consistent across.4he- three ages. Females wrote 
more good papers than males in all assessments at 
each age and for all but one task. The 
male/female difference did not change 
appreciably for any agegroup. : — - 



Black youngsters improved either absolutely or 
elatively-joitaUnost^l-jKriti^ 
and 17-year-olds and one task given to 9-year- 
blds. In some cases this meant that they continued 
to perform beloy^ the national level, but not as far 
below as they had been in 1969 or 1970; in other 
cases, this meant that they performed at the 
national level after once.hayjng been below it . 

At age 17,- the disadvantag^d-urban group made 
steady gains over the decade. At age 13, the group 
stayed below the national level or fell even farther 
behind. Nine-year-olds in the disadvantaged- 
urban group closed' the gap between themselves 
^ind the nation on one expressive writing task but 
remained at a constant level below the nation on 
therest. 



At all three ages, it appears that a considerable 
proportion of young people— frorrt 10 to 75%--^. 



do not understand the nature and conventions of 
written langiiagp In an <>arUpr r 

Writing MechanicSi 1969-74 (1975), we noted that 
the gap between the writing **haves"« and the 
yhave nots'* seemed to be widening. The more 
comprehensive data available now do not indicate 
that the gap is widening^ They do indicate, how- 
ever, that it has not closed appreciably at any age. 

Finally, it is clear from the background ques- 
tions that neither, 13-year-olds nor 17-year-olds 
receive a great deal of direct instructid^n in wnting 
or are required to do mych writing in school. Very 
few appear to have access to a writing program 
that includes {^rewriting instruction, oral and 
written feedback on writing assignments, encour- 
agement to write several, drafts of papers and 
o pportuniti es t o rework p apeis af ter thev have 



been reviewed by teachers. 



CHAPTER 5 



SOME OBSERVATIONS ABOUT WRITIMG IN AMERICA, THE 
ASSESSMENT RESULTS AND THE IMPLICATIONS OF THEv 
RESULTS FOR INSTRUCTION 



In order to put the 'assessment findings into" 
perspective and stimulate discussion oif the issues 
they raise, the National Assessment invited five 
nationally prominent individuals to discuss and 
interpret the data. Participating in two days of 
lively conversation about the subject were: 



V. Jon Beniz, Director , of Psycmnogicaf 
Research and Services, National Personnel 
^ Department, Sears, Roebuck and Com- 
pany, Chicago, Illinois. In addition to his 
interest in writing and assessment from a 
corporate point of view, Mr. Bentz has 
been a member of two boards of educa- 
tion and the Policy Committee of the Na: 
tional Assessment of Educational Progress. 

Beverly Bimes, English teacher, Hazel-' 
^ wood Schools, Missouri. Ms; :Bimes is a 
...^ Title I consultant. Gateway Writing Pro- 
ject consultant. Presidential Scholar Com- 
missioner and 1980 National Teacher of the 
Year., 

Charlot'te Brooks, writing teacher, author, 
editor, education consultant and past Pres- 
ident of the National Council of Teachers 
of English. ^ : 

'John Mellon, linguist, author and Chair- 
man of th^ Program in English Composi- 
tion. University of Illinois at Chicago Cir- 
cle. 

Richard Lloyd-Jones, Chairman, Pepart- 
ment of English, University of Iowa; past 
President of the Conference on College 
'Communication and Composition; Chair, 
Modern Languages Association Division 
on the Teaching o^" Writing; an4 Associ- 



ate Director, Iowa-National EndoAvment 
for the Humanities Institute on Writing. 

Al! present felt .it was important for readers of 
this report to understand the National Assessment 
data and the social and educational contexts 
within which w riting instruction ta kes place before 
rushing to conclusions about what these results 
might mean. After establishing this contextual 
framework,, the panel discussed at length the sig- 
nificance of the trends and their implications for 
vteachers of writing. Their opinions are theirs alone 
and do not necessarily represent either the views of 
tfie institutions with which "they are affiliated or 
those of the National Assessment of Educational 
Progress, the Education Commission of the States 
or the National Institute of Education. 



' Assessment Data in Perspective 

All participants wished to emphasize the fact 
that the writing upon which this report is based 
was first-draft writing gathereci under timed 
assessment, conditions. Such writing is likely to 
understate youngsters' abilities to develop fully 
their ideas and smooth out their writing through 
subsequent drafts. ' 

In addition, some of the ass^ auents are 
necessarily artificial and may underst ue the 
writers' capacities to do a better ^ ir> - * eal 
world" or school situation when real stakes are in- 
volved. 

John Mellon stressed the point that NAEP data 
are descriptive, not normative. **lt's easy to think 
something's wrong when performance is down," 
he .said, **but it's not necessarily the case. ItV 
really hard to tell what these ups and downs mean 



until we've got 50 years of them, then, maybe 
we'll see thar th^^y smooth out to a relatively 
straight line. In the meantime, 1 prefer to view the 
results as descriptions of something complex ana, 
except in extreme cases— or instances when we 
:_have other kinds of data to bring to bear— with- 
hold judgment until we have a belter idea of what 
we can reasonably expect the results should be in a 
society like purs." 

Richard Lloyd-Jones speculated about what 
kinds of changes would most likely affect national 
indicators such as ithese data: "Crises in the 
society as a whole may, show up in a saimple of 
writing' quickly because they may affect the 
incentives students feel to perform well in these 
circumstances. Long-term changes in society may 
^how up less quickly and dramatically in data of 
this kind. Changes caused by classroom practiqes, 
"would s^^ up- slowly, if ct all, because the 
teachers remain essentially 'the saijie, the time 
devoted (or not devoted) to yriting remains rela- 
tively stable and instructional materials remain ^ 
much the same for'long pencds of time. By and 
large, the most likely causes of changes in assess- 
ment data ^^ill be large social movements that/ 
affect large subgroups of people— such as integra- 
tion, for instance— rather thah^ curricular or 
instructional movements, which tend to cancel ' 
e^cKother out across the nation as^a y^hole." 

The Social dbntext of Writing 

\ Like many commentators upon contemporary 
. leducation, the participants in this discussion 
Isiressed the degree toiwhich sociocultural factors 
pn influence achievement in a j^pbjepL-oUCh as 
writing. People perfect their language skills in oral 
practice, mostly outsi^de of school. Because 
writing isrdljBrived from that base, it tend^ to reflect 
whatever is part of general public practice. In ad- 
dition, if the culture at large seems to accord little 
importance to vyriting or to writing well; if pro- 
fessional >yriting is not generally held in high 
vsteem; or if sociaS upheavals affect opportunities 
to learn, practice or value any of the many skills 
involved in writing, then we should not be, sur- 
prised if achievement appears, sometimes, lower 
than we thinkit should be. 

Jon Bentz believes that society has been valuing 



writing less and less in the last two decades. 
'•Everything is computerized, quantified, visual or 
audio," he said. "Respect for, or even interest in. 



the written word is on the decline;\ And the art oT 
conversation, of interchanging thoughts, appears 
to be passing, or at least changing in character. In 
o^r McLuhanesque world, fewer people reason, 
while more make demands aid pronouncements. 
Television, primarily a passive experience, reduces 
the need for imagination and interaction, both 
of which are critical for good writing." 



In response to the cieclines in /the proportion of 
youngsters demonstrating effective ^persuasive 
writing, Lloyd-Jones speculated that we might be 
witnessing a consequence of thi? "Me" generation. 
"Persuasive writing requiresja highly developed" 
social sense," he said, "an ability to imagine other 
peoples' needs and priorities in order to address 
them. Perhaps" we're seeing a decline in the 
proportions of youngsters /able to imagine other 
people or experiences outside of a very narrow 
range of self interests. " / 

Beverly Bimes added the observation that "if 
the social experience of argument is weak or 
shabby! it's hard to see how our students could 
learn good argument or/persuasion." 

, All agreed that writing is a complex and dif- 
ficult skill, requiring considerable motivation to 
learn and numerous good models to learn well. 
Social changes that affect^motivation or the avail- 
ability of models will affect the number of young 
people who learn to write well. 
' ■ . . -^^ ' 
Mellon mixed some ^advice about society's ex- 
pectations with a speculation about the slight de- 
cline in overall qtiiality at age 17 and the larger 
decline at age 13. "It may be that, as Piaget 
ren^ '**ked,: Americans ate too concerned with ' 
- u u which their children develop," 

t N we'f^r seeing a slight slowing d vn 
wiruu we u cd to think of as the 'normal' develop- 
mental schedule. The skills will come eventually, 
but they're coming a little slower than they used 
to, that's all. A complex social change could 
conceivably delay the cognitive or emotional de- 
velopment of a particular generation in some 
respects, while speeding it up in other respects." 
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The Educational Context of Writing 

the discussants ^rere in general agreement that 
■^TTinnlrer of the "characteristics of-Amene^^ 



education a'.iu a number of educational trends 
combine to constitute a less-than-ideal environ- 
ment for the teaching and learning of writing. 
Among the features of our educational system 
. that make effective writing instruction xlifficult, 
they cited these-as prominent: 

• Writing requires* considerable one-to-one 
teacher/student and student/student inter- 
action, while our system is geared to instruct- 
ing large group;. Furthermore, class size con- 
tinues to grow, not shrink, making individual 
aitentibn nearly impossible. 

• Writing instruction is considered to be the 
—responsibiiky-only-ef-Eng4i^ teachers Thtis^ 



- an activity that should pervade instruction in 
ail subjects is relegated to a small part of a 
student's day and severed from general learn- 
ing. Furthermore, many teacherS deprive stu-^ 
dents of, writing opportunities by giving 
iTjultiple-choice and short-answer tests and 
shying away from essays. j 

• Many people teaching English were trained in 
other subject areas and know little or nothing 
dbout writing. 

• too many people trained to teach English still 
' have had little or no training in coniposition 

or writing. ^ . - 



• Many English teachers see themselves as liter- 
ature teachers, not writing teachers. When 
they do teach writing, they^end to focus upon 
the products of writing, rather than the prb- 
'cess. •' '. ■ ' • " • ■ 

•Writing requires practice, bj; ^>r;" teachers 
feel they do not have the :.rnc o lead and 
critique alt the piapers that woulu be written if 
their students were practicing as they should 
be. Consequently, less writing is assigned than 
should be. 

In addition to these general problems, which 
have a long history, the discussants also citedi 



several more recent trends iri education that do not 
auger well for writing instruction. Charlotte 
Brooks criticized a "lock-step" approach to learn- 
in g that has become increasingly popular with the 
minimal competency movement and tighter edu- ' 
cation budgets. • 'Writing'is not something a child 
can jearn a little piece at a time,-' she said. "So 
many of these competency programs break read- 
ing and writing up into bits: first, you master the . 
alphabet, then you master words, then you can go 
on to sentences, and so on. The child seldom gets 
to see the larger picture, seldom gets the freedom 
to explore with language and take risks." 

Bimes said, "I think the basics movement has 
been detrimental iri many ways to .writing. Too 
often, what's basic turns but to be mechanics and 
grammar, not writing. And expressive writing, 
.which /5 basic; is seen as a frill: We have to re- 
member that a writer has feelings and a writer has 



a mind. Tb deny either of those is to deny a stu- 
dent the possibility pf becoming a^writer at a;«.'' 

Bentz saw^ budgetary cutbacks as ijiore threat- 
ening to writing than to other subjects. VThe. 
cutbacks in my state generally mean the schools 
lose. the paraprofessionals and readers who help 
writing teachers with their paper load," he said. 
"They also cut into the conference time teachers 
need with their students."/ 

All agreed that publishers represent a coriserva; 
tive force in the teaching of writing. It is very 
difficult to get publishers td incorporate new ideas 
intojheir writing textbooks, they argued,' because 
~tlTeT5ublishcrs-are^afraid-tO::tak^Gonomi.G-risks-in- 
today's tight market. Gonsequentiy, major 
textbooks have not changed for decades, in spite 
of a virtual explosion of useful research and 
pract4calinformation in the field of writing. ' 

"I think we should remember that a lot of very 
positive things . have been happening in. the 
schools since the late 60s," Brooks reminded the 
group. "It hasn't, been a totally negative period 
for writing. We've had the Right to Read pro- 
gram, and where it has been done well, it has 
helped writing, too. I don't like tol separate read- 
ing and writing, because they feed each other. And 
we've had th^j Poets in the Schools Program and 
the various humanities programs that expose stu- 
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dents to writers and scholars, these have~been \ 
very successful where they've been useii. And 
some schools have begun to follow the example of 
Englahd with Writing Across the Curriculum pro- 
giaius. INe- b*ceir-thesp work-7^ 
they're tremeridously impressivei'^ 



••We've seen writing labs, top," Binies added. 
•*And a mushrooming of programs modeled after 
r the Bay Area Writing Project. It may be that. these 
developments are too recent to affecf the 1979 
writing assessment, but we might see some impact 
in the next assessment, if they continue to spread 
and escape cutbacks." 

Comments About the National Results 

The discussants were asked whether they 
thought the percentages of competent papers for 
each exercise and at each age were lower than they 
-would likex highe r or about w hat they mi ght-have- 
expecte^.*In general, they felt that the achieve- 
ment lcy<;ls were satisfactory, given the social and, 
educational environments of writing in the last 
decaide. They were, however, disappointed with 
the results for the persuasive writing, especially at 
ages* 13 and 17. And, as might be expected, they 
felt there was some room for improvement on 
every exercise. 

Lloyd- Jones pointed ; out that in the papers 
written for each assessment,: there were "some- 
astonishing papers^any reader would be pleased 
and challenged by them. . Even though they write 
und^;r restraints of limited time, artificial tasks 
^ajid„noL^xlfimal-reward,'' he said^-ilsome-writers 
far exceeded any reasonable expectation. " 

- . • . ■ ■ - "» ■ 
* Most writers, the group felt, produced "rea- 
sonably adequate first 'drafts for their age." The 
average paperneeds revision, they pointed out, 
and it falls short of effective or powerful writingi 
but it represents material a teacher ought to be 
able to help students refine to a perfectly accept- 
able level. The potential of the majority of writers 
is obvious. 

However, the group was strongly disappointed 
by the consistent reminders in the data that 10 to 
25v and sometimes 30%, of the youngsters at each 
age have extremely serious problems with writing 



' that cainFor special litfentioh. Alt 
Jones estimated that half of the students in that 
group are probably there for reasons other than 
lack of competence (e.g., physical, psychological 

- and social problems), everyone still felt the 
proportion of such youngstes is unacceptably 
high. "It's hard to imagine that one of a child*s 
fi?st instincts is to want to write,'^ Bimes said. ••In 
fact, children attempt" to Write before they even 
think about reading. What have we done. to this 
natural desire in our childrefi?"' 

What did the group think about the trends? No 
\ one believed the NAEP data support fears of a 
;\ massive erosion of writing competence. They all 
^^dbserved that the holistic-scores decline at age 17 
was slight— worth kfeepirig an eye on but not sflf- 
ficient to provoke great concern. They would.have 
preferred to see an increase. They felt the age 13 
decline was^more dramatic, but they pointed put 
— that mnsf nf It Qcnirred h etween the first fWQ 



assessments and things seem to liave settled down 
since then. They were gratified to see improve- 
ment among the 9-year-olds and expressed hope 
that this would bode well for the future. 

Bipies expressed concern about the low per- 
centage of 17-year-olds who attempted to write a 
humordus paper. "It appears that students aren't ' 
given ^opportunities to use higher-lever cognitive 
Skills in their writing," she said. 'Too many 
writing assignments simply become a way for 
students to regurgitate information instead of/ 
'^(equiring them to generalize, analyze, synthesize, 
hypothesise or defend." ^ . 

Comments About the Group Results 

' - J ' \ ^. . • • ■ . • ^" ' - . ■ ■ 

Brooks spoke for tiie entire group In saying, 
am enormously encouraged by the consistent 
growth demonstrated by black and urban-dis- 
advantaged writers on most exercises. At all levels, . 
it's clear that something has happened to help 
these young,sters write better. Although many of 
them have not yet reached a high level of writing 
competence,\they obviously have a potential for 
improvement that educators, legislators and the 
public large must recognize. There is 
competence where once^ people said there was 
none." 
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— It was-this-improvement,, coupled Svith the im- 
provement of the Southeastern region pn many 
exercises, that led the group to speculate that the 
assessment results may reflect the. impact of a 
change in the natjonal patte rn of attention paid to 



minority ypungsters over the last decade and a 
half. "Something of that magnitude could well - 
affect large groups such as the blacks, the urban- 
disadvantaged and the Southeastern youngsters," 
said Lloyd-Jones. • Brooks agreed, noting that . 
"there is no economic improvement in the inner 
city that I know of that could account for such an 
ilnprovement.'- 

Some Implications of the 
Results for Teaching 

^Responses to the background questions demon- ^ 
strated to the group that too little writing is going 
on in the schools and too few students are being 
exposed to a comprehensive writing pro g ram. The 
fact that so few students appear . to receive v 
instruction in prewriting, oral and written feed- 
back from leachers and encQuragementi to 
improye^apers after they're handed back indi- 
cates, th^ said, that there is much work to be 
done in the schools. 

, "I think the results show a clear lieed for more 
writing laboratories in the schools," Bimes said. 
"But they also show a great need for professional 
development. Teachers need first to see themselves 
as professionals and th^n to participate more 
widely in the various workshops and inservice pro- 
grams in writing that have begun to appear in the 
last five years. Jhere's a lot of information out ^ 



persuasion, but more attention to complex think- 
ing skills^ general. ^ In reading, I'd like to see 
more emphasis on inference and comprehension, 
because I think that would improve both jeading^. 
and writing. They don't need to be taught sep- 



"\yriti.rig labs, yes," Brooks added, "but not' 
remediaL writtng" courses. I think 'remedial' 
courses that fragment language have not Jielped in 
reading and I'd hate to see us make the same 
mistake in writing. Too many remedial writing 
courses just teach grammar and don't give.young.- 
sters opportunities to work with whole pieces of 
writing." " . 

"I'd like to see more emphasis placed on 
persuasive writing." Bentz said. "To me, that's 
critical to success outside of school.'* urooks 
agreed: * I'd like to see not only more attention to 



arately and taught a piece at^ time." 

Speaking about the grammatical structures used 
by writers at the three ages, Mellon observed; 
"The amazing stability of the syntax counts over 
the 10-year period suggest3 that grammatical 
maturity is not^affected by those cultural factors 
influencing other aspects o^ students' writing. It 
also means that there is no heed to step, up the 
amount of grammar teaching aimed at maturity of 
grammatical structures." ^ 

"The greater length of the 9-year-olds' essays 
shows a greater willingness ~to write," Mellon also 
remarked.. * That 'V encouraging and we should 

_take_advantage.oLitJll^ - ■ ■ " ■ _ 



"Writing begins with enjoyment," Bimes said. 
"Until we teach children to enjoy writing we're 
, , not going to make the improvements, we could 
otherwise." — . 

"We have a base to build on," Brooks pointed 
out, "the results show that. The raw material is 
certainly there, the skills are there for most 
youngsters. We can no longer assume that any 
group of kids is 'unteachable.'" 

■■ ' •* , .' . ■ 

The F/oup mB^^c a number of suggestions about 
jiaf classroom appVbaches. that would* help more 
younf.sters learn- to write. Among them were 

~Ihese: ~ ■ - ■ — — ~ 



• Get ;the 9-year-olds* "hooked^' on writing by 
assigning writing suitable to their age aild in- 
terests. Help them build security and interest 
through expressive writing and then lead 
them toward more difficult modes gradually 
Let them experiencesuccess. 

• Build on the fact that all youngsters have a 
solid grasp of oral language. Use that base as 
a springboard for writing instruction. 

• Have them write. No one can achieve success 
in a skill that is seldom practiced. 



' • Structure assignments so that writing becomes " • Develop persuasive writing skills by deyelop- 

discovery instead of regurgitation. ' ing a sense of audience. Have them, practice 

^ writing for different audiences. 

• Establish places where students write freely 

• ' and receive-constructive feedback on what' •Teach skills useful at each stage of the writing 

- — theywrite ~ — ~' — ~" ~ — pro c e ss: pr cwfthngrcomposlngTand-edi^ing^ — 

• Since l3-year-old^^pear to have difficulty • Integrate writing into all activities— science, 
with abstraotjioi^wt them on concrete, ex- , social studies, even mathematics. Writing -is 

^ • pression - and then move them gradually to- an important and vcry^effective way of learn- 

ward generalizations until they are skilled at i^^g- 
. " . making generalizations supported with 

concrete details. " ^ . ^ 
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— — ^ — ■■ — APPENDIX A 

EXERCISES, DOCUMENTATION, SCORING GUIDES AND SAMPLE PAPERS 

Appendix A contains exercises and information r numr ;r of lines students had on which to write, 

about them, such as. the NAEP bbj Following each exercise are any scoring guides 

d[esigned to assess, the kinds of scoring National ^Jsed for evaluating the responses, and following 

Assessment utilizevlwith each one, the amount of the guides are sample papers illustrating each 

time students were given to respond and the score point. 
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V ^ y- "Kangaroo^' Exercise ? ^ - 

Here; is a picture of a kangaroo in Au^t¥^ picture 
for a while. What do you .think is happening? Wherc^^ 
the kangaroo came from? Where do you . think he is going? Look how 
high he j umps! 'Why do you suppose he is jumping over the fence? 

Write a- sjto:|fy about what is happening in the picture. 
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WRITING TASK.: Kanqaroo . 

NAEP #: - 0^ 102013 -13 A- V"- "~7~ 7 

RHETORICAL MODE: Expressive - Narrative. 



OBJECTIVE: ; : 

SUBOBJECIIVI:; 
NAEP SCORING ; 



Denionstirates ability-, -in ,wr-itinq to^Treveal-^person-a-l- 
feieiinqs. and ideas. ^ . . , 

B. Through the use of conventional modes of discourse 

Holistic . *; ' • ' ' ' 

Paragraph Coherence - 

Syntax (Sentence Types) 'ind Mechanics (see' Appendix B) 



AGE: 

TOTAL- TIME IN SECGNDSf 
NUMBER OF LINES: . 



_9__ 
933 

p.1 - 13 
p. 2.- 24- 



Score P oin t Categories : 



HOLISTIC SCORING GUIDE 
"KANGAROO" 
AGE 9 



^oi:e~(rf~~r 



These writers will enter into the picture 'iinaqinatively usirvg: sucli 
devices as dialogue and character names. jThere . will be cileai^ 
structure and a sense of ^di^ama,; which will answer the ^'what^^^arid 
"why" of the question. The "where" may or inay not be des^cribedr V 
but thre paper will have a sense of substaince^ ^ The writing will ^ 
usually have some spelliiiq and sentence ctonstruction errorg but * 
will show a plear sense of >Ehqli^sh syhtax. . 



Score of 3 



These papers will leave out parts of the picturer .such as -the ; , 
fence or the ium,pr and will have less completeness , or drama than 
the 4 paper. They may qive cbmme|1tary /or explanation rather than 
a story. They will have" subsVance^ soijie/sense^ dramar ar}d sbme; 
imaqinationr and they will deal with t^e "what" and the "why" of J 
the question. The\writing heed not haye' much* subordinationn 6r ■ 
syntactic \fluency ^ byt it will not be\-,so filled with Errors aM to 
be difficult to read. 



Score oi 2 



The 2 papers have some sense of narration ^nd situation; however 
1:he story will be fraqmen ted or incomplete^ t the\-w 
vaquer . and there will be little use off the ^ma^intf;i&.ion. Thie 2 
papers may iqnore the picture hut use the situation^ They will. be 
very brief; studded with errors^ and jmay Contain only a single , 
complete sentence oir a series of speculations about othe picture.^ V 



Score of 1 



The papers score^. as a 1 may be minimal attempts^ sometimes only 
phrase. The papers may be unfathomable because of errors/ There : 
may be no sense of narrative and^ thps^ only a series of 
unconnected statements. ^ . 



Score of 0 



No-response papers should be- qiven to the Table Leader for 



scoring. 
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PARAGRAPH COHERENCE SCORING G 
(Developed for the 1973-74 Writing 
^ "KANGAROO" X 



UIDE 

Assessment) 



/' 



Paragraph Level Scorfes" 



1. 



2. 



Paragraph 
but is 



Used — The .pa ra<^ raph is visually discernible 
neither coherent nor developed. The writer 



indented, skipped a^^line, or stopped in the middle of the 
line and started ba1::k at the margin. 



Paragraph Coherent — The sentences are linked using 
transi tions^^and/or other cohesive devices. The ideas are 
ordered and their relationship to each- other is clear but 
the paragraph is in 'some sense underdevel'oped. This 
category also includes pa ragraphs that ar^ overdeveloped; 
that/Msf the writer incorporated at least tv/o coherent 
pa^iragraphs into on^. 



3.x Paragraph Coherent and Developed — The paragraph has an 
/' expressed or an. implied topic which identifies- and limits 
/ the main ^rea of concern. Every sentence in the paragraph 
adds to 6x explains something about the main topic in a 
^ systemati c manner . / 

NOTE: Papers that are illegible, copies of the stem, or lists of 
spelling words are designated as such and receive no further 
scoring 
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SAMPLES 



Holi^ic 
Score Point 1 



SCcfre Point 3 



^Vf t^*^*^ Vt g. iy^A*^j v^^n VTjk 

jo<»ip'; y/^^^^ y V'^a^ 



* i « 



« * « * « 



<vw»t-fl-wa. All 




IIT^^ "V^^^v^ - 



Score Point 2 



Score Point 4 





. y ^ if so- hg And H ^ 




.>4// of — i^rwi g/ LMfiard^ juM^^ 



^ w 



raa/; %J UtLm iVgijnfiaii'^ rf/itiij i/irti/ii narrrui^ 



if/ "^^^^ h ^-4 ta'^ni K—^-^-f^' — 
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Fireflie$" Exercise 



Here is a picture of a girl who is having fun in the summer. Look 
at ' the picture for a while. What do you think r^he? is doing? What 
do you think she might do next? 

Write a story that telTs^ what the picture is about. 



WRITING TASK: Fir^iflies 

NAEP #: 0-102012-13A-1 ' 

RHETORICAL HODE: Expressive - Narrative 

OBJECTIVE: I. Demonstrates ability in writinq to reveal personal 

feelings and'id^asr 

SUBOBJECTIVI::: B., Through the use of conventional modes of discourse 

NAEP SCORING: Primary Trait: Imaginative explanation by means of 

narrative. 

Cohesion 

Syntax (T-unit Analysis and Sentence Types) 
and Mechanics . (see Appendix B) 
AGE: _9 

TOTAL TIME. IN SECONDS: 921 , 

NUMBER OF LINES.: p. 1 - 15 - 

p. 2 - 24 

NOTE: The picture used In the assessment wa^ in color. 



TRAIT SCORING GDID£ 



Rhetorical M ode: Expressive - Narrative 

g yim ary Tr ait; Imaginative explanation by means^ of narrative 
invention. 

Ratio nale of PrimarY Ty^it: This exercise presents two challenges to 
the writer. The firsts introduced with the guestion, "lhat do you 
think she is doing?** asks the writer to explain. The second 
question, "Hhat do you think she might do next?*^ introduces the 
problem of time and fiction which is confirmed by the directive, 
"Hrite a story," The two directives, then, require respondents to^ 
use the conventions and techniques ot storytelling as a framework 
for inventing explanations of "what the picture is about." 

General Scoring R ationale ; Essentially readers should concentrate on 
whether the response only offers direct answers to the questions 
or whether it goes on to tell a story • iriters who only offer 
direct answers to the question (s) ar<> sr?Q ri>f| hiw «2**: those who — 
^qo on to write a story re~efch~the »«3" or "4«« levelT A detailed, 
concrete description will earn a "2" while a less attractive, 
generalized narrative might earn a "3", The best papers tell a 
fully controlled and detailed story. 

Some elements of the exercise are not relevant to the writing, 
Hany children do not know what fireflies are. Readers must ignore 
the literal fact and accept the writer's interpretation when 
accounting for the actions. In addition, the introduction states 
that the girl is having fun; however, this thesis is insignificant 
and its inclusion is not necessary to complete the task. 

Scoring Guide .(rft tegorjes ! 

0 = No response. / 

1 = SQme_expjLanatj,on^, but nQ_ ng^tca^;j;^_4gygg^4QQ^ These responses 

deal with the explanatory obligation of the task at a minimal 
level. That is, they answer one or both of the guestions with 
a few bits of information (2 or 3) which tell "what the 
picture is about." 
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gcori n q Gtt ide„^Ca teq or ies {con tinaedl : 



2 = Mod e rate to _ am ple expla na tion^ but little or no 

nar rative inventio n. Essentially, these responses are longer 
versions of ^^ateqory "1" responses. They explain "what the 
picture is j^^out" by proyiding moderate to ampdSe (4 or more) 
details. !Efey are not set in a story framework although some 
may include minimal attempts such ^as giving the girl a name pr 
implying a cause and effect ^relationship or a time seguence« 
No matter the number of details or an attempt to get into a 
storytelling framevorkr these responses remain little more 
than discrete or disconnected answers to the questions posed 
in the stimulus. 

3 = Ima gin ative explanation^ bv means of narrative inven tion. 

These papers invent details and cast them into a framework. 
They use several storytelling devices such as naming 
characters, setting scene,, temporal or causal linking, 
dialogue, etc. However, they remain flawed in the sensed ha t~ 
the stories are not sustained. For example: 1) they may begin 
with question answeirinq before moving into storyteliing, 2) 
they may set up a situation but the plot or narrative is only 
o#f< ^ e d i -n- bar e outlin e form — (no. mor e than one or tw o bi ts-of-^ 



invented information) , or 3) they may set up a situa4:l^n^_and-_- 
qet into the story but either lapse out of storytelling into 
question answering or leave it unresolved, hanging in mid^air. 
In summary, the "3" responses explain the picture through 
storytelling but do not demonstrate full control. 

* ^ Imaginative exolanationy bv means o f dev elppe^ and co ntrol led 
narrative _inyenti on. These responses explain the picture 
through a fully controlled and detailed story. They set the 
scene immediately, invent moderate to ample details not 
provided by the picture, cast the details into a narrative 
without lapses and provide a conclusion to their story. 

7 = Illeq[ible, illiterate^ 

4 

8 = Misunderstands the task, writes on another topic. 
9=1 don't know. 
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COHESION SCORING GUIDE 
(Developed for the 1978-79 Wr i ti ng Assessment) 

"FIREFLIES" 



, In scoring papers for- cohesion, scorers need to be attentive not 
only to the incidence of cohesive ties but also to their 
successful order ing , ; Underlining and further strengthening these 
ties is syntactic repetition, both within and across sentences. 
The following example achieves cohesion by lexical cohesion, 
conjunction, reference, and substi t ution , and yet these various^ 
kinds of cohesion are^both emphasized and related among themselves 
by numerous incident-s of syntactic; repetition. 

There is a girl who is catching fireflies. She is 
puttting some into a jar. When she is finished, she will 
take them into a dark room' and' watch thera glow. After 
that " she will let them go so that they could lay eggs 
and there will be more fireflies for next year. Then 
she can catch them agai n yeail' "af~^^ — 

When both the incidence and ordering of cohesive ties pattern the 
entire, piece of writing, th e .jw rit - er has rr p af prl wh -a4 : we ordinarily. 
call coherence^ 



Scoring Guide Categories 

1 = Little or no evidence of cohesion .. Basically^ clauses and 
. sentences are not connected beyoiid pairings. 

2 = Attempts at cohesion . There is evidence of gathering 

details but little or no evidence that these details are 
meaningfully ordered. In other words, very little seems 
lost if the details were rearranged. 

3 = C ohesion . Details are both gathered and ordered. 

Cohesion is achieved in the ways illustrated briefly in 
the definition abova.^ Cohesion does not necessa rily lead 
to coherence, to the successful binding of parts so that 
the sense of the whole discourse is greater than- the 
sense* of its parts.. In pieces of writing that ar'e 
cohesive rather than coherent,, there are large sections 
of details which cohere but these sections stand apart as 
sections . 



Coherence ♦ While there may be sense of sections within 
the piece of writing, the sheer number and. variety of 
cohesion/ strategies bind the details and sections into a 
wholeness. This sense of wholeness can be achieved by a 
saturation of syntactic- repetition throughout the piece 
(see description above) and/or by closure which 
retrospecti^vely orders the entire piece and/or by general 
statements which organize the whole piece. 

Illegible, illiterate. " 

Misunderstands the task, writes on another topic. 
I. don't know. 

NOTE:" Scorers should not take mechanics or transcription 
errors into consideration. Also, the scorers should j udge 
only the inter r elatedness of the ideas, NOT the quality of 
those ic^eas . 

Examples of Cohesive Ties ; 

In — g-e n erajr-y ^-e h c sion" r e f e rs to the — ways claus e s and s e nt e nc e s - 

are related to each other and can be thought of as the gathering 
and ordering of related ideas. If the parts of a discourse cohere, 
they "stick" or are " bound" together . Cohesion is achieved by ties 
of considerable variety, and these ties can be both semantic and 
structural. Additional examples of specif ic. kinds of cohesion ties 
are identified by Halliday and. Hasan in Cohesion in English . 

Lex ical Re -naming ' 

The girl has a jar to put bugs in. The bugs are called 
fireflies. 

Semant ic Co nj unction 

Additive - 

The girl is catching lightning bugs. She is also 
catching butterflies. 

Adversative - 

1 wanted to help the little girl catch fireflies, but I 
couldn't find her. 

Ca usal - 

This little , girl is trying to catch ^ fi refl ies £o she can 
^ake .them to sci.ool. 



7 = 

8 = 

9 = 
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Temporal - 

Shi. s ca ^ l ing lig' ' nir bugs and putting them in a 
jar. Next she will show them to het iuother* Later she 
might let them go. 

Pronominal Reference 
Personal - 

There once was a girl. She liked to catch bugs. 
. Demonstrative 

' She is collecting bugs. This collection is for her 
science class. . a 

Comparative - 

I wish I had some bubbles 1 i ke hers. 
Pro-form Substitution 
Nominal - 

The lightning bugs are out and the little girl wants to 
catch some . 



Clausal (use of so and not ) - 

The little girl knows they are fireflies because her 
mother said so . 



Ell ipsis 



Nominal - 

The girl's mother told her to let the bugs go but she 
wouldn' t [ ] . 



Verbal - 

she had to go to her room " and couldn't come out until 
her mother said she could [ ]. 

Clausal - 

She is catching either ligh.tning bugs or butter flies . but 
r don" t know which [ . ]. 



\ 



Nojie: While helping plan ::he 1978-79 writing assessment. National 
Assessment consultants expresised the opinion that coherence and 
cohesion (deserved special consideration and that a more thorough 
method of describing information about coherence was needed. In 
consequence/ this cohesion scoring guide was developed and used 
with the "Fireflies? exercise to replace the paragraph coherence 
guidelines, developed in 1973-74 and used with the "Kangaroo" 
exercise . 
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SAMPLES 



Primary Trait 
^oint 1 



Score Point 3 




« « « « * 




Score Point 2 




« « « « « 






_^ — - . . - ^ 

jgTjytu^ Xffc. ^y?^. MJLjt^ Jaji^ ^^4^ a/rwK 

^ ^^rifcn^ cLn^ -^^(Wn fi^J^ ^ — . 



-IF— ♦ * # «- 



-2 



/ "-ki 



Cohesion 



Score Point 4 



Score Point 1 




JIM* 



* * * . * « 




Win 



. ■ r- 



t 



X 




Score Point 2 



anJ lut 



/yvC dt^g ^uf 



3: 



any 



AC- 



• • • » • 




Score Point 3 




* ♦ ♦ ♦ 




■rf^ii^ttfA anv<7 ^^^^ 



:^f. jj ^ft^^. ..^'J 



Score Point 4 

■ \ 




^"^'^^^^^ 




^tt^^i^^^y^^ ^^^^^^^ ^^"^^ 

A^i^kj ^'^^i ^^^^^ 




J 



^^ ylJ J 11^^ iTlifft I i (fl 
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'Goldfish" Exercise 



Sometimes it is fun to think about what it would be like to be 
something besides'a person. What would' it like to be a goldfish? 
Or an i;airplane? Or a horse? Or a^tree? Or any other thing? : 

--h^ ■•• • •/ • . , ' • • • ^ 

Thihk.;about what you would like to be. Write the name of the thing 
in i the box below.., Th^n write about what it is like to be that 
;thing. Space is provided below and on the next two pages. ' 
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K-WRITING TASK: Goldfish^ ''' 

■ NAEP #: 0-101 006-52A-1 

".RHETORICAL MODE: Expressive 

OBJFCTIVE: I,, Demonstrates ability in writing to reveal personal 

feelinqs and ideas. 

SUBOBJECTIVE: A. Throuqh free expression / :' 

NAEP SCORING: Primary Trait: Expression of participation in an 

existence different f rem Iself through elaboration 
of detail. 




BEST i^^^/ 



r 
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TRAIT SCOEING GUIDE 
"GOLDFISH" 



Bhetorical Mode: .Expressive; 

££iE!S£Y-» Trait: Expression of participation in an existence different 
from self through elaboration^of detail. 

Rationale _Qf_Primary , Tr ait ; The instructions stress "what it is like 
to be that thing." The guality of a paper is determined by two 
factors: 1j the extent to which the writer is able to assume 
another form of existence and 2) the degree of specificity the 
writer uses to elaborate how it is to exist as that form of being. 

Geqeral Scoring Rationale ; Competence is indicated by the invention 
and elaboration of consistent detail. Readers should mainly take 
into account the guantity of detail and whether that detail is 
particularized to the selected object — for example, almost any 
"thing" could be happy, fewer are cute, still fewer are fuzzy, and 
^only cats meow. Better papers will not only express a number of 
details focused on "the thing" but will elaborate those details in 
a sustained and consistent fashion. The best papers will be 

^ unified by some expressive or logical principle. 

i« - 

Scoring , Guide ..,CategQx:ies; " - _ 

0 = No response. 

1 = Little or no expression of what t he th ing is like. These 

responses offer only a minimal amouht of detail. Some may 
offer a few (up to 3) highly specific details, but the 
responses are iust too sparse to convey anything beyond a^ 
limited expression of what the thing is like. Others may ^ 
offer more (as many as 5) bits of information, but some or 
all of them are too vague (or even nonsensical) to help 
particularize the thing the writer wants to be. 

2 = Moderate expression of what,.,the thing^is like. These 

^responses are moderately detailed. They include 4t5 details 
which particularize what the thing is like. Yet they either 
are too brief or possibly include extraneous or vague bits of 
information so that their expression' of what the thing is liKe 
remains incomplete or fragmented. 




responses may take several possible forms. 

a. They may include 6 or more details which particularize 
what the thinq is like* However^ details tend to be 
briefly stated (not elaborated) and only a moderate 'degree 
of linkaqe between the details is present. 

They may contain only 4-5 details. However , several of 
these details are elaborated, ^.The information seems to be 
presented in clusters. 

c. They may include 5 details related to each other by means 
of a narrative or characterization. 

In summary^ the "3" responses particularize the "thing" but 
lack elaboration and unification of detail. They may even 
• contain some • inconsistent elements* 

^ - ^2Dsistent_and_vivid_ex£Eess^ 

These responses are highly detailed ^6 ox: more details some of 
which are elaborated) and are unified by the presence of some 
kind of expressive^ or logical principlre~ — ~~ 

7 = Illegible^ illiterate. 

8\ = Misunderstands the task, writes on another topic. 
9=1 don't know. 



BEST 



ERICS 
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SAMPLES 



Primary Trait 
Score Point 1 



Score Point 3 



decrmft , t ^^^^ I'ft 



^ 3gti Ton anl 8* ^ g<y<U 



««*.«* 



Score Point 2 



^^^^^^^^^^^^^^^^^^^^ 



^^^^^ 





/A rt oL^:^^ , ^ , „^ 




* « « « * 



4 Rflcg^ C.a^ 



rtw, ftf a1kt^ KiiA )>wK> HftS^ I'll bf. 



^iyJ# >/J/ ^^ fl>J ^M^JtuU 



^^^^ 



« • * • • 



hu a iiBf m Pirf. Ikk paiaa otf«l 

yt^A,A T ..^>U Qj^A rrLem. mJ 

^i^^ K^pl^ ;n Ak^ uiir^A iuUK 4he 



:i:V u»»uVA ,^^)uL ^•. WpA^Va ^ Siic^ Winy 




Score Point 4 



TV -P - -1- . IJ 



M sTf- 



Jill 



nit^ — nryl. 



It. 



iia 

lAf Q m& ik^tv A^.'^k '^ft%i>^ 



— f|l — ' — ' — tf y ■ -f i a I 

j-p -t-V iiv-V ganv Qrve_„ qt^gj >^i^^k ■ 
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"Puppy Letter" Exercise 



Pretend^^ that you family is moving to a new apartment. The 
landlord* has refused to let your puppy 1 ive there . W rite the 
landlord-— a l^ter ^ trying to convince him to I'et you keep your 
puppy in the new apartment. 

Space -is provided below and on the next two pages. Sign your 
letter "Chris Smith." 



^ 240 West Street 

Big town f Pennsylvania 
January 4, 1979 



Dear Mr . James ^ 



WRITING TASK: Puppy 

NAEP #: 0-201001-52A-1 

RHETORICAL MODE: Persuasive - Social/Personal 



OBJECTIVE; 



II 



Demonstrat esV aMlity to write i n response to a wide 
ranqe of socie\=al demands and ODliqations . Ability 
is 'defined to ' include correctness in usage, 
punctuation/ spelling, and form or convention as 
appropriate to particular writing tasks, e.g., 
manuscripts,, letters. 



SUBOBJECTIVE: 
NAEP SCOR-INo: 



A. Social 



^. Personal 



Primary Trait: Situationally unique persuasion through 
makinq of appropriate appeals. 



AGE: 

TOTAL TIME IN SECONDS; 
NUMBER OE LINES: 



9__ 

74 3 
p.1 - 10 



p. 2 - zr 

p. 3 - 21 



\- 



. TEAIT SCORING GOIDE 
"LETTER TO LANDLORD ABOUT PUPPY" 



^keto£ical_Mgde : Persuasive - Social/Personal 



PrimarY_.Trait: situationally unique persuasion through majcing of 
appropriate appeals. 

-Rationale,gf_2riinarx_TraU: Essentially this is an exercise to. 
determine how well a nine-year-old can cope with rhetorical 
appeals. The request for a letter to a landlord establishes a ^ 
particular audience. The situation, keeping a pet in the face of 
- opposition, focuses the writer's appeals. By directing the writer 
to try to convince the reader, the exercise is persuasive, so a 
fully successful performance must contain appropriate 
appeals/reasons. 

iieneral_Scorijig[_^ Given the linats of time and the age of 

the children^ it vould be unreasonable to expect elaborately 
structured arqu!;nents. Even the better Writers may produce 
appeals/reasons ^ in a relatively discrete manner — apparently 
thinkinq of onev writing it down, thinking of (another, etc. 
Therefore, readers should concentrate attention on the writer's 
success at finding and formulating appeals appropriate to the 
^;,a-udience and situation^ " » 

Scoring Guide Categories; 

• 0 = Nd response. " . — . 



1 = 



- liSltets_]^ckina_a££eals^reas These letters either contain 

no appeals or only name inappropriate or vague reasons. They 
tend to 1) be confusing in that it is difficult to understand 
what the situation really is or what the letter is supposed to 
accomplish, 2) be comprised mainly ofo threarts of violence or 
retribution r or 3) reguest to keep the puppy but offer no 
appeals or only offer a reguest with one general statement 
which is not sufficiently specific or relevant to be 
considered an appeal. 
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S corin g Guide Cat eggries (continued) ; 

2 = letters with limited ap pe als/reasons ; ^Letters in this 
category cover a broad range, but all are in some sense 

un d e rjde V elope d ^ S ome letters request to k e ep the puppy and 

oI'feF^'^one'o^F "two practical or sympathetic appeals. Others 
pffv^r several (2 or more) appropriate appeals or general 
statements, but only infer that the purpose of the letter is a 
request to, keep the puppy, if a response includes a request 
and several appeals one of vhich is inappropriate, the 
persuasive qualities will be less effective and the letter 
will probably remain in the "2" category. ^ 

L e tters substan tiated with appropriate rappeii is/reas ons; 
Generally these letters include a request substantiated with 
approximately three concrete appeals* However, some "3" 
letters cite numerous (U or more) reasons but they are 
presented as a list rather than a unified request, j Unusually 
effective presentations of pathetic appeals or rational 
negotiations may also be classified in the "3" category. • 



3 ^ 



4 = 



letters developed and su bsta ntiat ed with appropriate 
ap peals/reasp Qs . These letters are organized such that they 
operate as a unified piece of persuasion. They tend to have 
openings, closings or both and contain numerous or more) 
appeals. Not all of the separate appeals need to be 
developed, but usually one is, and all the appeals are 
appropriate. 



7 = Illegible, illiterate. \^ ■ 

8 ^ Misunderstands the task, writes on another topix:. 

9 - I don't know. 

KOTiS: Some examples of appeals are listed on the following p,age, 
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Ty p es o f Ap prQpriate_ Appeals/Reasons : 



1) Practical/Specific - "He's house trained," ««He doesn't shed." 
"I'll take him for walks*" "He doesn't bark." "I'll qive him 

_bath s." "Doesn 't ch ew on_JEarniture^ " "He's quiet." "He's a 

small breed," "I will pay more rent," "I won't let him 
outsider except to take him for walks," ^ 

2) Sympathetic/Pathetic - doq birthday present^ pleading (I will 
cry, ple'a[se, please) ^ had doq since was baby^ the doq will 
dier doq leqacy of dead grandmotherr dog only friend,, etc, 

3) Other - suqqestinq a tryout period, nice introductions (allow 
me to introduce myself) # observinq that you understand why the 
landlord doesn't allow pets, etc^ 

Types of I nappropria te Ap pe als/Reasons : 

Hildly inappropriate— offer tb qive dog to landlord, will / 
move if" can't keep dog; the doq will never go outside, 

. ■ ' .•./••■ 

Totally inappropriate - violent threats, giant bribes, 
childish ranting - "I will hate you," 

3) Contradictory - good watch dogs that don't bark or bite. 

Types of _yaque_Appeal s/Re ason s and General S tatements: 

"I'll feed my doq," "He won't wreck the apartmont," "I'll take 
. care^of my dog," "He's a black and white dog," "He 's ^small I V 
: ^ be no trouble," "I love my dog," "He's cute,"^^'^;"I want to 

V keep my dog." "tly dog is harmless,^' 



1) 

2) 



SAMPLES 



Primary Trait 
Score Point 1 



Score Point 3 



Jib 



/)//■ PA»A-rk Up 



^if^-Uy ' If i- hint -i^'o.y anZ 




r ^m/ ^^^^ 



Score Point 2 



t 



■4i (ef ^.r 



3J 



o ■ ■ ■' . ' 



» *> ♦ ♦ ♦ 



■ flAlL ' 



• • ♦ ♦ ♦ 







1 



Score Point 4 



^ la^fe^ — f^fy <Ufty^ ^^Uo.^ "^kwytL'^j. 

^'^f^^^^ ^"^^r ^ ^^^ 

.^y ^J/ t^^^ \.y^ ^ -TLa 
^ rem I k t y i7V> f^y Hi k; j fat h # n ; 



■ \ 



5? 




LkifrviA. ujQrtNife ,'^.cJ\y .fUj>pp<t/v 
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Poster Calendar" Exercise 



FREE — THE POSTER CALENDAR OP YOUR CHOICEI I I 

Get a beautiful poster calendar free! 
. ' a Choose either : 

1, Famous Rock Group 

; ; " . , or ' 

2. Mountains and Stream 
Tell me which poster you want. If ypu ask me for it and 
tell me your name and address^ I will isend you your 
beautiful poster. 



Sincerely^ , 



Mary Jones / Manager 
National Book Store 



/ 



Pptend that your name is Chris Brown and' that you live at 37 Elm 
reetj Gulf ^ Ohio 76543. On the'next page^ writhe a letter to Mary 
Jbnes .reques^ting the , calendar 



WRITING TASK: Poster Calendar 
NAEP #: ^0-202031-AlA-12 
RHETORICAL HOPE: Exp lan ator y - Business 
OBJECTIVE: II. 



SUBOBJECTIVE; 
NAEP SCORIIIG; 



Demonstrates ability to write in response to ■ a wide 
I ranqe of societal demands and obligations. . Ability^ 
\ is defined to include correctness in * uaa^e^ 
punctuatlonr spelling> and form or convention as 
"appropriate to particular W|riting .^tasks/ ^ e,,g«^ 
manuscript^/- lettQ;cs. :^ 

B. Business/Vocational - . \ j- 

Primary Trait: Expldnation 'through supplying bf 
information in a form required by a situeition. • 



AGE: 

TOTAL^TIME IK SECONDS: 
NUMBER OF LINES: 



9 

407 

p. 2 - 1 0 



13*/ 
4' 1,6 
_P_il. - ' 23 



TRAIT SCORING GUi^DE 
"POSTER CALENDAR" 



R hetorical 'mae ; Explanatory - Business 



Pri.marY_Tra&t: . Explanation through supplying of information in a .form 
require^ by a situation, 

Ratior>^le of Prim ary Trait : The stimulus for this exercise require 
/ respondents to clearly communicate the information necessary to 
; receive the poster calendar of their choice. It alsp suggests^ 
/ ^:hat the response should conform to the conventions of d letter 

request. The main issue is will the letter accomplish its pur^^i 
^ — the/receipt of the selected poster calendar. The tone and J* 
^ style of the letter are of lesser importance, ^ <f 



of 
se 



Gene ral Sc oring Rationale ; The main criteria for rating this '^exercise 
are the 'presence and accuracy. of the information transmitted. 
Readers should^ look for .a greeting^ the name of the sender, the 
address of the sender^ a request, identification of the poster 
calendar. and ^ statement of choice. 

Scoring Guide C ategories ; 

0 = No response. 

1 = Name or address is in some crucial sen^-;e incomplete and/or 
calendar not referred to in an/ way. 

2 = The writer gives name and address and requests or refers to 
calendar, but does not give a specific choice. 

3 = The writer directly requests calendar (i.e., something like 
"Please send me the free poster calendar"); gives. name and 
address; states choice. 

7 = Illegible, illiterate. 

.8 = Misunderstar»ds th'e task, writes on another topic. 
9 = 1 don"t know . - 



NOTE: 



Due to the straightforward nature of the task, this guide did 



. .not include a category "4." It was felt that 
•'■ 'no further elaboration was necessary. 



a "3" was sufficient and 
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Aiso, to maximize reporting capabilities Na^:.onal Assessment 
categorized the following six pieces of information as present or not 
present. ,v The "four trait categories were 'erived through data 
analyjsis^^.^ 

A: Greeting/Miss, Mrs.^ Ms., Mary Jones, To Mary, Manager 

National Book Store 
B: Name/Chris Brown., Chris, Brown 

C: 'Address/37 Elm Street ^ , " 

Gulf, Ohio 76 543 
D: Request/Please send me the free poster calendar ' 
E: Refers to calendar or poster or picture 
F: States choice 
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SAMPLES 



Primary Trait 



Score Point 1 



Score Point 2 



♦ ♦ * ♦ ♦ 



Acj^J^ . 



Score Point 3 







***** 



,i^»yLj:xAA-V-^S.S._.U_, . • 
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APPENDIX B 



GUIDELINES FOR SYNTAX 

Appendix B contains outIinQ$ of the features 
National Assessment hand tabulated for the 
unit analysis of syntax, the sentence-type analysis, 
and the mechanics analysis. It should be noted 
that since National Assessment computerized the 
text of all the papers involved , in these studies, 
basic descriptive cbunts (average essay length. 



MECHANICS ANALYSIS 

average word length, etc.) were machine tabu- 
lated. Rationales, as well as detailed definitions of 
the outlined features, are contained in Mullis and 
Mellon (1980). Also, the detailed guidelines used 
by fhe.scorers'^who accomplished these tabulations 
are available from National Assessment. 



SYNTAX SCORING GUIDE OUTLINE ' 
T-UNIt ANALYSIS 
(Developed for the 1978-79 Writing Assessment) 
"Fireflies" — Narrative Exercise 

T-unit delineation ~ A T-unit is one main clause with all its 
phrases and subordinating clauses. (Fragments are included^ 
with either the preceding or the following T-~unit, as 
^PPJ^opr iate. ) 

Embedding 

A. Nominal i zation 

1. Nominal Clauses — clauses used "as subjects, direct 
objects , ^subject complements or objects of prepositions 

2. Nominal Phrases — phrases used as subjects, direct 
objects , sub j ect complements or objects of prepositions 

B. Modification 

1. . Ad jectival . , . 

a- Relative Clauses — clauses that modify nouns or, 
occasionally, complete sentences including clauses 
of time, place and manner. 

b. ' Mo d 1 f y i ng Ph r as e s — restrictive and non- 

restrictive phrases directly following the nouns 
they modify, 

c. Transposed Modifying Phrases ■ — non-restrictive 
phrases - separated from the nouns they modify, 
verbal phrases, nominative absolutes, appositive 
noun phrases. 

d. Genitives ' -- possessive phrases, pre-noun proper 
name pj3^ssessives arid possessive pronouns. 

e. Single Word Pre-noun Modifiers — adjectives that 
precede the nouns they modify. 
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2. Adver^iV 



a. Adverbial Clauses — clauses of reason (cause/ 
purpose) — because, condition — if, .and concession — ■ 
a 1 though . " 

b. Adverbial Phrases phrases of reason (cause/ 
purpose) —condition and, concession . 

Conjoining and Connective Devices 

A. Coord inate * 

(Since NAEP computerized the text for the essays, counts 
of both intra- and inter-T-unit uses of "and" and "or" 
were machine tabulated.) — 

B. Semantic (other logical relationships) 

1. Time naming structures — clauses or\phrases thet 
establish time. 

2. Adversatlves and lllatlves. — words, clauses, or phrases 
that establish timie.^ 

3. Other signposts — words, clauses, of .phrases that 
indicate an addition, a sequence, or a comparison. 
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SYNTAX (SENTENCE TYPES) AND MECHANICS 
SCORING GUIDE/OUTLINE 
(Developed for the 1973-74 Writing Assessment) 
• "Fireflies" — Narrative Exercise 
"Kangaroo" — Narrative Exercise ^ ^ 

Sentence Level Syntax Categories 
Description of Sentence Types 

1. Minor sentence (correct cagment) — A word group 
used'' in dialogue fif^or er.r , .::siSf pr as an exclamation 

" - that is not an independent clause^ 

2. Simple ■ — A sentence that' conta ins a subject and a 
verb. It may also have an object o'r a subject 
complement i 

• ■ ■ 

3. Simple with phrase — A simple sentence that contains 
. a prepositiofiai r infinitive^ gerund a«id/or participial 

phrase. Sentences containing appbsitive-s/ noipinatiVe - 
absolutes/ and verbals were also scored in this 
category. 

J" 

4. Compound — A sentence containing two pr more simple 
sentences joined by something other than a comma. 

5. Compound with phrase — A compound sentence containing 
at least one phrase in one of the independent ^clauses. 

6. Complex (and compound-complex ) — A sentence containing 
at least one independent clause and one dependent 
clause. 

* " 

7. Complex (and compound-^compl ex) with phrase — 

A sentence containing at least one independent clause^ 
one dependent clause ^ and one phrase. 

Sentence . Level Mectianics Categories^ .... 

Sentence Types with Punctuation Errors (sentences that do 
not fall into any of the syntax categories) . 
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1. 



Run-on Sentence 



a. Fused ~ A sentence containing two or more 
independent clauses with no punctuation or 
conjunction se^parating them, ^ 

b. On and on — A sentence consist! ng of four or more 
independent clauses strung together with 
conjunctions. • 

c. Comma splice - — A sentence containing two or more 
independent clauses separated by a comma instead 
of a semicolon or a coord i nat ing conjunction, 

2. Incorrect fragment . — A word group, other than an 
independent clause, written and punctuated as a 
sentence. 

NOTE: T]^e scoring of T-unit constituents made. it. possible 
for some' of th« preceding sentence types* to be derj^edthrough 
data analysis for the "Rainy Day" papers, 

B. Faulty Sentence Construction (These scores are in addition 
to the sentence types.) 

1. Agreement Erro r --*'A- sentence where . at 1 east one o^f 
the follawing is present: i^ub j ect/verb do not agre^, 
pronoun/antecedent do not agree, nbun/mod if ier do not 
agree, subject/object pronoun misused-, and/or verb 
tense shifts. 

2. Awkward Sentence (The awkward categories are listed 
in order of category precedence, since only one score 
was given to a sentence.) 

a. Faulty parallelism — A parallel construction that 
semantically or ' structurally dysfunctional. 

b. Unclear pronoun reference A pronoun ' s anteceden 
is unclear • 

. . » 

c. Illogical construe tion --Faulty modification or a 
dangling modifier or a functionally disarranged 
or misproportioned sentence. 

d. Other dysfunctions^ — A sentence containing an 
omitted or extra word and/or a split construction 
that definitely detracts from readability. 



lit. Punctuation Errors — Every error of commission and error of 
omission is scored for commas^ dashes^ quotation marks^ 
semicolons, apostrophes, and end marks. The most informal 
rules- of usage are used with the writer receiving the 
benefit of any doubfe. 

IV. Word Level Mechanics Categories 

A. .. Word Choice -~ The. writer needs a word that is different 

' from the one written. This category also includes attempts 
at a verb, adjective, or adverb form that is nonexistent 
or unacceptable. 

B. Spelling — In addition. to a misspelling, this category 
includes word division errors at the end of a line, two 
words written as one, one word written as two, superfluous 
plurals, and groups of distinguishable letters, that do not 
make a legitimate word. 

C. Cap iza tion — A word is. given a capi tal i zation error 
scor? if the first word in a sentence is not capitalized, 
if a proper noun or adjective within a sentence is not 
capitalized, and if the pronoun "I" is not capital ized . 

The mechanics :: coring was designed to allow the writer as much 
flexibility as possible under existing rules of correct writing; 
consequently^ any time two authorities on mechanics disagreed,, the 
most informal interpretation wao used. 
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group results, exercises evaluated 
for p rimary trait and cohesion 



' The table? in Appendix C present group dif- 
ferences froin the national percentage, not the ac- 
tual perforniance of the .group. Thus, if the 
national percentage for. a particular item is, for 
example 71 and the group difference from the 
nation is 12%, the group percentage, or per- 
formance levd, is 71 plus 12, or 83%. The ad- 
vantage to p' esenting group data in terms o^f dif- 
fereflces is^th"ar~sucfina!SlS to see 

whether the relative position of a group, vis-a-vis 
the nation, is changing. As before, an asterisk next 
to a group difference signifies that the difference 
is statistically significant; an asterisk next to the 



percentage estimating the chainge for that group 
signifies that the change is statistically significant. 



Table C-1. 


"Fireflies" Exercise, Primary 




Trait 


table C-2. 


**Firefli|s" Exercise, Cohesion 


Table C-3. 


• 'Goldffsh' ' Exercise, Primary 




Trait 


Table C-4. 


"Puppy Letter'' Exercise, Pri- 




mary Trait 


Table C-5. 


"Poster Calendar'' Exercise, Pri- 




mary Trait 




0 ' ■ 




r 



J" 



1^ 



97 



Nation (%) 



Region 
Southeast 



1970 
.1974 
1979 
1970-79 



TABL E C-1 . Group Differehces-Fyom-Nat'onal Percentages/ 'Tir^^^ 
Primary Trait Scores, 1970,1974, 1979^^ 



Developed 
Story 



1.9 
1.4 
0.6 
•1.3* 



0.0 
•0.5 
•PI 
•0.1 



Year 


N on rateable 


Some 


Ample 


Adequate^ 






Explanation, 


Explanation, 


Story 






No Story 


Little/No 
Story 






0 


1 


2 


3 ^ 






• y 






1970 


5.4 


31.7 


46.1 


' 14.8 , " 


1974 


4.3'' 


21.8 


58.4 


,14.0 


1979 


3:3 


29.3 


57;3 


' 9.4 


' 1970-79 


2.0* 


-2.4 f 


* 11.2* 


-5.4* 



7.4* 
3 0* 
1.0 
-6.3* 



. 1.5-^ 
1.1 
0.3 

-1,1 



-3.6 
2.3 
-0.9 
2.7 



-5.2* 
-5.9* 
^0.3 
4.8* 



West 



457a- 



Central 



Northeast 



r Sex 
jyiale 



1974 
1979 
1970-79 



-1.6- 
-0.2 
0.1 
1.7 



-4.2 
2.5 
4.0 
•0.1 



■3:7" 
-4.2* 
-5.4* 
-1.7 



0.4. 
2.3 
1.3 
0.9 



0.8 
-0.4 

0.0 
-0.8^ 



1970 




0.1 


3.7 


-1,2 


•0.8 


1974 


^ 0.2 


•1.4- 


-2.0 


3.2 


0:1 


1979. 


•0.7 


-3.0 


2.7 


1.3 \ 


-0.2 


1970-79 


1.0 


•3.1 


-1.0 


2.6 


0.5 


1970 


•1.5* 


-5.3 


1.8 


4,7* 


0.2 


1974' 


-2.2* . 


-1.3 


3.1 


0.1 


0.6 


1979 


•0.5 


-1.8 


4.0 


-2.0 


0,3 


1970-79 


^1.0 ■ ■ - 


^3.4 


2.1 


-6.7* 


0.1 


1970 


2.0 


4.2* 


-3.0* 


.-2.8* 


•0.4 


1974 


1.7* 


7.4* . 


-5.7* 


. ^3.1* 


•-0.3 


1979 


1.5* 


7.7* 


-5.2^ ' 


-3.7* 


-0.2* 


1970-79 


•0.4 


3.5* 


-2.3 . 


-0.9 


0.1 



.'J I 



ERIC 



TABLE C-1-Conr//)yecf. 



Female 



. .Year 


iNonrateaDie 


oome 


Ample 


Adequate 


Developed 






Explanation, 


Explanation, 


Story . 


Story 






NoStor/ 


Little/No 










0 


Story 


- 






0 


1 


2 




A 


ly/u 




■4.4 


3.1 


2.9* 


0.4 




-1.0 


^, -6.8 


5.3 


2.8* 


0.3 


1979 


•1,5* . 


-8.0* 


5.5* 


^3.9* 


^ {).3; 


1970-79 


OA 


. -3:7* 


2.4 


1.0 ^ 


c^-0.2 



Race 
White 



-Blacl<- 



Parental education 

: Not grad. high school 1970 

■r- ■ . 1974 

■ / • 1979 
1970-79 



Grad. high school 



Post high' school 



1970 
■1974 
1979 
1970-79 

1970 
1974 
1979 
1970-79 



2.7* 
2.1 
6.8* 
4.1* 

-14 
■•1.'3 
■1.1 
0.3 

■2.7* 
■0.9 
^1.0 
1.7 



4.1 
3.3 
8.7 
4.6 

•4.1* 
•2.0 
•1.5 
2.6 

•3.3* 

-5.7* 

'•• -2.4 

f 



> 



•1.5 ; 

•1.3 
•12.7* 
•11.2 : 

4.9* 

2.0 

1.2 

•0.7 
•1.0 

5.9* 



^4.5* 
-3.6 
,•2.2 
2.3' 

0.8 
1.2 
.1.4 
0.6 

5.3* 
6.1* 
1.0. 
•4.2* 



■0.7 
•0.6 
-0.6* 
•0.^ 

■0.1 
0.2 

0.1. 
0.2 

1.5 

' 0.0 
0,4 
•1.1 



2,3&4 

6.4* 
8.4* 
9.6* 
•3.2 . 



1970 


•2.5*. 


-3.4* 


•3.4* . 


•2.0* 




5.9* 


1974 ' 


eO.9* 


•2.4* 


1.4 ' 


1.6* 


0.3* ' 


3.4*' 


1979 


•6.9* 


■0.7 


0.8 


0.8* 


■■'0.1 


1.5. 


1970-79 


1.7* 


2.8* 


■2.6* 

> 


•1.2* 


. -0.5* 


^•4.4* 


— 1970" 


12;5'T 


13.4* ■ 


-14.4* 


•9.7* 


— 


• •25.9' 


1974 


5.3* 


^^ 1.2.5* 


. ■S.S ' 


■8.4* 


' -1.1* 


■17.8* 


197^^ 


2.9 


3.4 


■3.5 


--3.0* 


■ 0.2 


-6.3 


1970-',;) 


•9.7* 


•10.0* 


10.8'v' .'..^ 


. 6.7* ' 


2.0' 


19.6* 



■6.8 
-5:5* 

-15.6* 
•8.8 

5.5* 
3.4 
2.6 
■2.9 

6.1* 
5.2* 

,6.7* 
0.6 



TABLE CAr- Continued, 





Year 


Nonrateable 


Some 


Ample 








ExDlanation. 


ExDianatii 








Kin Stnrv 












Story 






0 


1 


2 


Typeofcommunity# 










'Disadvantaged urban 


1970 


130* 


17 8* 






1974 


6.4* 


18.5* 


■13.5* 




1979 


4.6* 


5.7 


' -6.2 




1970-79 


•84* 


■12 1 




^Rural 


1970 


2.4 


86 


.5 

■27 




1974 


2.8 


•1.4 


■9.2* 




1979 


■0.5 . 


>l:4 \ . 


4.3 




1970-79 


-28 




7n 


Advantaaed urban 


1970 


•25* 


.19 Q* 


« R 1 
\ D.I 




1974 ' 


■3.6* 


' -4.2 


■ ''■..2.1 




1979 


■2.5* , 


•3.3 


1.4 




1970-79 


nn 

u.u 


Q ^ 




drade 










\Z .. . . ■ 


' 1970 


81* 








1974 


5.9' 


10.5* 


■7.2* 




1979 


4.6* 


- 9.8* 


•10.5* 


v- ..■•>* 

i-''"' ' 


1970-79 


■3 5 








1970 


■31* 


•5 7* 

J,/ 


CO* 




.1974 


•1 7* 

It ' 


.2fi* 


1 i)* 


.y; ■ ■ 


'1979 


' -1.9* • 




.4.3* 




1970-79 


1.1 


1.9 


. -0.9 ■ 



fSmjsticaliy significant at the .05 level. . 

percentages rhay not total due to rounding error, 
fthese population groups represent about one-third of the sample. 



Nation (%) 



Region 
Southeast 



Wesf 



Central 



Northeast 



Sex 
Male 



TABLE C-2. Group Differences From National Percentages, "Fireflies" Exercise 
Cohesion Scores, 1970,jl974; i979'\/ 



Year Nonrateable Inadequate 



/Attempts at 
Cohesion 





0 


1 

1 


I 


1970 


5.4 


3Q 1 


*rJ, 1 


1P.74 


4.3 






i979 


33 

WfW 


9ft fi 

40,0 


AR n 


1970-79 


•2.0 


•0.3 


2.9 


1970 


7.4* 






1974 


30* 




•U.o 


1979 


1.0 


2.6 


•1.5 


1970-79 


•6.3* 


0.7 


0.5 


1970 


•1 6 


4.C/ 




1974 


•0 2 


n 1 


1.2 


1979 


0.1 


4.5 


•3.8 


1970-79 


1.7 


•0.4 


0.4 


1970 




•u./ 


4.9 


1974 




1.1 


•2.2 


. 1979 


•0.7 


■1.0 . 


0.5 


1970-79 


■ 10 


-U.o t 


A A 

A A 


' 1970 


•1 5* 


■V 

•0.0 


. •0.3 


1974 


■22* 




1 0 
1.0 


1979 


-0 5 


' *v).y 


4.7 


1970-79' 


1.0 






1970 


2.0* 


! 

1.2 


-0.4 


1974 


1.7* 


1.5 


fi.3 


1979 


" 1.5* 


4.1*^ . 


-1.7 


1970-79 


•0.4 


' ■ 2.8 


-1.4 



Cohesion 



-2.4 
-3.1* 
-3.3* 
•0.9 



Cohesion and 
Coherence 



0 
0 


4 


3S(4 


on c 


A A 

2.0 


,22.3 




1,7 


25.5 


on fi ^ 

zu.y 


4 A 

1.0 


21.9 


0.5 


■1.0* 


•0.5 


s 


A M 

•0.1 


•7.3* 


•0./ 


A A 

. ■O.B 


•7.3* 


■1.7 


•0.5 


•2.2 


5.5 


•0.4 


5.1 


n 0 
0.3 


A n 

0.7 


1.0 


-0.7 - 


-0.4 


•1.1 


. -I.l 

Dp 


0,3 


•07 


-1.3 


-0.4 


; -1.8 


■ - 

-1.8 


•0.7 


> 

•2.5 


A A 

0.8 


0.2 . 


1;0 


j.6 


•6.3 


, 1.3 


3.4 


0.3 


: 3.7 


6.9* 


' 0.1 


7.r 


4.8* 


0.6 


5.4* 


1.3 


0.4 


1.7 


■ -5.6 


. 0.3 


. -5.4 



•(j.4, • 
•0.5* 
•0.6* 
•0.1 



ERIC , 



no 



TABLE C'2-Co/)f/nuec/. 



Year 


Nonrateable 


inadequa 




0 


1 


1970 


•2.1* 


■1.3 


1974 


•15* 


•1.4 


1979 


•1.5* 


■4.3* 


0-79 


'0.4 


-3.0 



Racs 



White 


1970 


•2.5* 


■3.7* 




1974 


■0.9* 


•2.9* 




1979 ■ 


■0.9* 


•2.1* 




1970-79'^ 


1.7 


1.7 


Black 


1970 


12.5* 


15.9* 




1974 


5.3 


15.1* 




1979 


2.9^ 


7.8* 


• 


1970-79 


■9.7* 


•8.2* 


^arcntal education 








Notflrad. high school . 


1970 


2.7* 


3.6 




1974 


21 


• 07 




1979 


6.8* ■ 


13.8* 




1970-79 


4.1 


10.2 


Grad. high school 


1970 


■1.4 


•1.4 




1974 


•1.3 , 


; 0.9 




1979 


•1.1 


•0.2 




1970-79 ■ 


■ " ,.' 


1.2 


P^st hi(]h school 


1970 ' 


. -2.7* 


•5.2* 




1974 


•0.9 . 


•6.6* 




1979 • 


. •I.O"' 


^•6.0* 




1970-79 ' 


' 1.7 ■ . 


•o;8 



Attempts at 


Cohesion 


Cohesion and 


Competent 


Cohesio[< 




Coherence 


or Better 


2 


3 


4 


3&4 


0.4 


2.5 


0.5 


2.9 


•0.3 


2.8* 


0.5* 


3.3* 


1.8 


3.5*. 


0.6*, 


4.0* 


1.4 


1.0 


0.1 . 


1.1 


3.0* 


2.8* 


0.5* 


3.2* 


0.7 


2.8* 


0,4* , 


3.2*: 


"41.5 


1.6 


•0.1 


1.5 


b 

V 


•1.1 


,•0.6* 


•1.7* : 


•14.1*' 


•12.4* 


•1.9* 


•14.4*/ 


•5.3* 


•13.7*" 


■1.4* 


■15.1* 


•3.5 


•7.4* 


0.2 


•7.2* 


10.7* 


5.1 ;■ 


2.1*^ 


7!2* 


1.1 


•6.6* 


•0.7 


-7.3* : 


•0.3 


•1.9 


. : -0.6 


-2.5 : 


•11.8 


•7.9 


•1.0 


■8.8 


•12.9* 


•1.3 


•0.3 . 


•1.5 V 


' -0.8 


3.8 


'•0.2 ' 


3.6 


•1.0 


1.0 , 


.0.4 


1.4 


•0.6 


1.7 


0.2 


, 1;8 - 


0.3 


■2.1 


0.3 


•1.8 


2.0 


4.5* „ 


1:4 . 


■ '5.9'-.? 


3.8*' , 


3.5* 


0.2, ' 


, 


2.8 


3.7* » 


, 0.4 


4.1*-/ 


0.8 


' -0:7 


•1.0' 


. -1.8 ; 



mi^O'l-Continued. 





Year 


Noiirateable 


Inadequate 


Attempts at 










Cohesion 






A 

0 


1 


2 


1 ypc ui lOinmunilyTr 








uiwuvoiudycu urDan 


1970 


13.0 


20.6* 


■17.0* 




1974 


G4* 


198* 


•y.D 




1979 


4.6* 


15.0* 


-12.5* 
4.4. 




iy/U"/3 


■8.4 


•5.6 


Rnnl 
nuidi 


1970 


2.4 


7.8 


2.5 




1974 


2.8 


•20 






1979 


•0.5 


-0.7 


•0.8 




1970-79 


•2.8 


•8.6 


•3.2 




1970 


•2.5* 


•9.1* 


4.0 






0 e* 
■0.0 


■4,4 


0.1 




. 1979 


•2.5* 


•5.7 


0.3 




.1970-79 


0.0 


3.5 


•3.6 



Grade 



1970' 


8.1* 


13.6* 


■ -8.4* 


1974 • 


^5.9* 


13.1* 


•7.0* 


1979 


4.6* 


10.1*' 


•4.8* 


1970-79 


•3.5 


•3.6 


3.6 


r. 1970 , 


•3.1* 


•4.3* 


3.2* 


1974 




•3.5* 


1.9*' 


1979 


•1.9' 


•4.1* 


214* 


1970-79 


1.J 


0.3 


•0.8 



Percentdges my not '\otal due to rounding em. 
§These population groups represent about onnhird of the sample. 



, TABLE C~3. Group Differences From National Percentages, "Goldfish" Exercise 
/ Primary Trait Scores, 1^4, 1979'V 

Year Nonrateabl& Little SomeDetaili' Elaborated Unified 
\ About Thing Thing Detailed 

Thing 





0 


1 


2 


3 


4 


1974 


4.6 . 


58.5 


23.5 


11.8 


1.5 


1979 


3.1 


568 


264 


12 5 


1 2 


1974-79 


•1.5. 


•1.7 


2.9 " 


0.7 


•0.4 


1974 


41* 


•1.4 


•40* 


1 2 


02 


■ 1979 


1.5 


' 1.9 • , 


•3.1 


0.0 


■0.3 


1974-79 


•2.4 


3.3 


0.9 


•1.2 


•0.5 


107/1 


■ .(14 ■ 


•u.o 




.9 1 


.1 1* 
•I.I 


1979 


•0.5 


7.2* 


•4.8* 


;-i.4 


'0.5 


1974-/S 


■0.1 


7.5* 


•8.8* 


0.7 


0.7 


■ 1974 


0.0 


•0.1 


•0.8 


1.2 


•0.3 


1979 


•0.6 .. 


•7.6* 


7.6* 


0.0 


0.6 


1974-79 


, ^0.6 


. -7.5* 


. ,8.4* 


•1.2 • 


0.9 


1974 


•2.8 ' . 


1.'3 


0.8 ' 


-0.3 


0.9* 


1979 


0.0 


•1.3 


•0.5 


■ 1.7 ' 


01 


1974-79 


2.7* 


•2.6 


, -1.3 


2.0 


•0.8 


1974 


- 2.5* . 


2.6* 


•1,7 


•2.6' 


, • -0,8* 


1979 


■ 1.6* 


]i 


' 0.3 . 


'3.2' 


•0.6* 


1.974-79 


•0.8 


•0.6 • 


1.9 , 


. -0.6 


, 0.2 


1974 


•2:5* 


' •2.6* 


; 1.7 


2.6* 


0.8* 


1979 


■ -i.g*" 


■2.2 


•0.3 ^ 


3.7* ' 


0.7* 


'1974-79' , 


0.7 . 


0.4 - 


-2.0 


1.0 


•0.1 



113 



TABLE Continued, 



Year ' Nonrateable 



0 

Race 

W\P ' 1974 .14* 

1979 -0.9* 

- 1974-79 0.5 

: Black 1974 gj* 

1979 3.7*- 

1974-79 -4.4 

Parental education 

• Not grad. high school 1974 4.7* 

■ • 1979 2^8 

1974-79 -1.8 

Grad. high school 1974 -0.6 

• 1979 ,0.2 

1974-79- 0.2 

, Post high school . I974. .2_i 

1979. -oie 

I974r79 ■ 1.6 

;Typeofcommunity# 

,:' Disadvantaged urban '1974 5.1* • 

i ' 1979 19 

. .; • , 1974-79 -3.2 

; Rural. . 1974 0.2 

.. . , ' 1979 1.2, 

1974-79 1.1 

■Advantaged urban^. • 1974 '.2.9* 
;' • •' ■ 1979' ^ 0.7 ' 

■ " • 1974-79 3.5 



Little 


Some Details 


Elaboratad 


About Thing 




Thing 


1 

1 


0 


3- 


-1.2* 


1.3* 


1.2* 


■3.2* 


57* 




■2.0* 


1 & 




5.3 


■7 Q* 


A Q* 


16.0* 


-11.2* 


■8.2* 


10.7* 


■33 


•0.0 


0,8 


- 

-1.7 


■4.2* ■ 


4."1 


•5 7 


•U.D 


3.3 


0.*T 


O.D 


-0.8 


0.4 


1.8 


-2.8 


V/iU 


o.H 


-2.0. 


-in ' 


1 7 


' -2.3 


1 0 




-6.7* 


5.0* 


1.3 


-4.5 ' 




n 7 \ 




•2.1 


-9.3* 


16.1* ' 


•8S* 




8.7 




n 1 

■U.I 


1.4 


-1.0 


'0.5 


4.8 


1 1 


-7 7* 


3.4 


21 


.7 5 


-7.2* 


3.7 


5.5* 


•15.6' 


0.9 " 


11.0 


-8.3 


- -2.8 


5.5 



" .A 

Hi 



Unified 


Marginal 


Competen 


Detailed 


or Better 


or Better 


Thini 






4 


2,3&4 


3&4 




.' 2.6* 


1.3* 


U.U 


4.1 


1.4* 


n 1 
•U.l 


1.5 


0.1 


•U.D 


■13.4 


■5.5* 


■0,3 ' 


•19.7* 


S8.5* 


U.o 


•6.3 


■3.0 


0.4 


■5.5 


-3.8*/ 




•7.0 


-1.8 


•I.D 


i' ■ 


2.0 


■0.8* 


1.4 


1.0 


U.o 


3.1 


3.7* : 


1 1 
1.1 


1.7 


2.8 


1 

1.4 


4.4 


3.4 


0.9 


7.3* 


2.3 


t\ A 

^11.4 


2.9 


•1.1; ; 


•1.1* ■ 


r 

■12.5* 


•10.4^, 


n 1 
•u.l 


ion* 


•9.5* 


1 n 

I.U ' 


r ^ 
•0.0 


0.9 


■0.1 


•1.6 


•0.7: ; 


U.D 


•b.U . 


•7.1* 


n 7' 

Uj 


4.4 ' 


•6.4 . 


0.9 


10.1*. 


6.4* 


.3.0 


14.9* 


14.0 


2.1 


"4.8 ' 


7.6 : 




TABLE C-3-Com/weflf. 



Year Nonrateable Little 
About Thing 



SomeDetdilr Elaborated 
Thing 



0 



Grade 



1 



2 



3 



3 


1974 


6.1* 


■ 9.5* 


■■7.5* 


'■6.5* 




1979 


2.2* , 


9.5* 


-3.7 


■7.1* 




1974-79 


•3.9* 


0.0 , 


3.8 


■0.5 


4 


1974 


■2.4* 


•2.4* 


2.4*, ■ 


2.1* 




1979 


■1.2* • 


■3.1* 


1.4* 


2.6* 




.1974-79' 


1.2* • 


•0.6 


■1.0 


'0.5 



5fa s/5mto,;afr/?fi .05 /ei/e/. 
'^Percentages my not tc^^ due to rounding error. 
Phese populdtion groups represent about one-thM of the sample; 



TABLE C-4. Group Differences From National Percentages, "Puppy Letter" Exercise 

Primary Trait Scores, 1974, igyS'V 



Year 


Nonrateabia 


No Appeals 


iSomc Appeals 


Good Appeals 


Unified 












Letter 




0 


1 


2 


3 . 


4 


1974 


9.3 , 


31.0 


44.2 . 


12.9 


2.6 


1979 


6.3 


32.r 


46.1 


13.4 


2.2 


1974-79' 


■3.0* 


: 1.0 


1.9 ■ 


0.4 


•0.3 


1974 


6.3* 


' 1.6 , 


•4.3 


•2.1 


• -1.5* 


1979 


4.1* 


2.5 


•4.5 


•1.9 • 


-0.3 


1974-79 


•2.2 


0.9 


•0.2 


0.2 


1.2' 


1974 


•2.5* 


■ 5.1* 


•1.9. 


-0.8 


0.1 


,1979 


•1.9 


0.9 


•0:1 


1.3 


•0.3 


1974-79 


0.6 


'■ -4.2 


1.8 


2.1 


•0.4 ' 


1974 


■2.9* 


2.9 


2.6.. 


•2.2 


-0.4 


1979 


•1.0 


•0.2 


3.5 


-1.4 . 


•0.7 


1974-79 


1.8 


•3.2/ 


0.9 


0.8 


-0.3 


1974 


. . -0.2 


•8.4* ^ 


2.6 


. ' 4.5* 


1.5 . 


, 1979 


-1.7 


. -3.7, 


1.6 „ ^ 


2.3' 


1.4^ 


1974-79 


-1.5 


4.8 


-1.1 


-2.2 


-0.1 


1974 


- 2.8* 


3.2* 


■2.7* 


-2.2* . ' > 


- -i.r* 


1979 


2.3* 


5.2* 




•3.1* 


-1.3* 


1974-79 


■0.5 , 




•0.4 . 


•0.9 


■0.2 


1974 


?.7* 


•3.1* 


•■'2.6*.- 


2.1* " 


1.1* 


1979 


■2A* 


•5.4* 


3.3* . 


3.2* 


1.4* 


1974-79 




' .2.3 


0.6 


1.1 . 


0.3 


1974 




. •ZS* 


2.7* 


1.4* ' 


0.3* 


1979 


■'•1.9* 


•2.3* 


2.4* 


1.5* 


• 0.3 


1974-79 


0.2 


•0.1 . 


•0.2 


0.2 


-0.1 : 
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Year 



• 




0 


Black 


' 1974 


12.3* 




1979 


9.2* 




"1974-79 


■3.2 



Parental^education 

■ Not grad, high school 1974 4.2 

• 1979 ' 8.6* 

1974-79 4.4 

. Grad. high school 1974 -0.7 

1979 -0.6 

1974-79 , 0.1 

Post high school ' 1974 -3.4*, 
■ '■ ■ 1979 ■ ■3.7* 

i: ; . ' 19^4-79 . :D.3 

Type of cbmrnunity# ' •'■ t \ 

Disadvantaged urban «1974 14.0* 

J 1979 7.9* 
1974-79' , -6.2 

Rural 1974 ' 5.7 

1979 , 6.9* 
1974-i79 . , i.1 

' ■ s' . ' 

:-Advantagedurban 1974 ■ -7.9* 

;•■ .. .; 1979 ■6.2* 





1974-79 


i.r 


Grade 








^974' 


9.5* 


■t-.-'. 


1979 


6.'6* 


^' ■ > ■ 

f. ■ . " 


. -1974-79 


,,-2.9* 

} 






t 




*» , ' 





TABLE OA -Continued, 



No Appeals Sonie Appeals Good Appeals 



1 


2 


3 


8.3* 


•11.2* 


.7.6* 


11.9* 


•12.9* 


-8.6* 


3.7 • 


•1,7 


1.6 


5.3 


•8.0* 


•0.9 


10.5* 


■ -9.3* 


-7.6* 


5.2 


■ -1.3 


■6.7* 


■0.7' 


1,6 


•0.5 


•2.6 


4.4* 


-1.1 


■1.9 


2.8 


■0.6 


■8.1* 


, 5.9* 


5A* 


-3.7* 


■ 0.8 


6.0* 


4.4* 


- "5.0* 


0.9 


h* 


•14.4* 


.■ •e.r 


11.3* 


-10.6* ■ 


•7.1* 


3.1 


. '3:9 . 


-1.0 


^ 4.9* ' 


•7.2* 


•3;2 


5.8- 


,,-5.2 


-6.4* 


0.9 


2.0 


■3.2 


-9.4* ■ 


10.4*' 


. 5.3* 


■10.8f ' 


7.9 


8.2 


* 


."•2.6 ■ 


2.9 


8.1* 


•8.9*..;'; 


■6.7* 


< 8.8*' 


•8.2* ^ ■ 


•5.9t.. 


0.7 


0.7 \ • 


0.8. 



Unified 


Marginal 


Competen 


Letter 


or Better 


or Better 


4 


2,3&4 


3&4 


■1.9* 


-20.6* 


•9.4* 


-1 6* 


-21 r 


•82* 


0.2 


•0.5 


1.2 


-0.7 


•9.5* 


■1.6 


-2.2* 


.-19.1* 


' •9.8* 


-1 5 


•9.6 


■82* ' 


0.4 


1.5 ,' 


•0.1 


0.0 


3.2 


■1.1 


•04 


1.8 


■10 


0.3 


11.5* 




06 


7.4* 


0^9 


0.0 




•1.7* 


■22.3* 


•7.8*" 


;1.5* 


" -19.2* 


. ■8.6*;^ 




31 


■•08' 


•0.3 


■10.6* 


-3.4 ^ 


' -1.1 


-12.7* 


<> 

.7.5* , 




•20 




1.5 


17.3* 


6.8* 


0 9 


17 0* 


91 


•0.7 


-0.3" ' 


2.r 


. -1.9* 


-17.6* 




•1.2* 


-15.4* 


■ .. -7.1*? 


0.7 


, 2.2 





u 



Year Nonrateable No Appeals Some Appeals Good Appeals Unified Marginal "Competeni 

or Better 
3&4 

2.9* ■ 
2.8* ' 
•0.1 , 

*Smisticallysigi)ificdntatthe))5M^ 

^Pemtdges my not total (lue to mnding error. 

^sse popuiatm groups represerit about orie^ird of the saiiip^^^ 







0 


1 


0 

2 


3 


Letter 

' ' 4 ' 


or Better 
2,3&4 


4 


1974 
1979 
• 1974-79 


■3.7* ' 

■3.3* 

0.4 


•2.3* 
■ -3.4* 
•1.1 


3.1* 
3.9* 
0.8 


2.2* 
2.4* 
0.2 


0.7* 
0.5* 
•0.2 


6:0* 

6.7* 
0.7 



TABLE C-5. Group Differences From National Percentages, "Poster Calendar" Exercise 

' Primary Trait Scores, ISTS^' 



Nonrateable 



Incomplete 



No Choice 



Successful 



Nation (%) 



8.3 



39.3 



3.4 



48.9 



Region 
Southeast 
West 
Centrals- 
Northeast 



3.9* 
•2.4* 
-1.3 
•0.5 



3.2 
0.9 
0.7 
•5.5 



•1.1 
0.4 
0.2 

0.61 



•6.1 

0.5 
5.4 



Sex 
Male 
Female 



2,5* 
•2.6* 



4.9* 
•5.1* 



o:3 

•0.3 



•7.6* 
8.0* 



Race 
White 
Black 



•2.5* 
14.4* 



..■3.6* 
15.3* 



0.1 
•0.9 



6.0* 
•28.8* 



Parental education 
Not grad. high school 
.Grad. high school 

. Post high school 



13.8 

•1.3 
-3.5* 



7.5 
0.9 
•6.5* 



2.2 

,:-1.0 

0.9 



•23.6* 
1.3 
9.1* 



Typeof community# 
Disadvantaged urban 
Rural . 

. Advantaged -iirbsn 



Grade 

; .3 Ir 
'::4" ■ 



/ 6.8* 
6,9* 
•6.2* 



9.0* 

•4.4*. 



f .15.2* 
6.9* 
•11.2 



7.5*^ 
■2.6* 



0.1 
•1.3 
0.0 



0.1 
0.1 



•22.2* 
■.-12.4* 
17.4* 



•16.7* 
7.0*- 



r,*Statistically s^^^^^^^ " 

■ A/ Percentages my not total due to rounding error. 

^^hese. population groups represent about one-third of the sample, 



APPENDIX D 



ERROR FREQUENCIES FOR GOOD AND POOR PAPERS 
AND SELECTED GROUPS 



The tables in this Appendix display error fre- 
quencies for papers defined as good or poor by 
their primary trait, holistic and cohesion scores (3 
and 4 = good, 1 and 2 = poor). In addition, error 
frequencies appear for males, females, blacks and. 
whites. Sample sizes were too small to permit 
analysis of error frequencies for other reporting 
groups. The column of figures under "average 
number" presents the average number of errors 



per paper. The column under "average percent" 
presents the average percentage of errors per 
paper. When the error is a sentence level error— 
for example, awkward or agreement— the 
'percentage represents the average percentage of 
sentences per paper containing that error.. When 
the error is a word level error (for example, 
spelling), the percentage represents average per- 
centage of misspelled words per paper. 
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TABLE D^l. Average Frequency and Changes in Average Frequency of Errors 
in Good and Poor Narrative Papers, Age 9, 1970, 1979t 



"Fireflies" 



•Sentence fragments 
Run-on sentences 
;)takward sentences 
^Faulty parallelism ; 
1^ Unclear pronoun reference 
f Illogical constructions 

Other dysfunctional constructions 
Capitalization errors . • 
Hisspel led words 
Hord-cholce errors 
^Sentences with agreement errors 
Jotal punctuation errors 
' Com errors 
■Endm^rk terror? 



Number of respondents 



1970 










1979 






Change 1970-79 


Eood Papers 


Poor Papers 


Good Papers 


Poor Papers 


Good Papers 


Poor Papers 


PT'3M 


PT 152 


PT 3M 


?hm 


■ ?im 


. PT 142. :. 


Avg, # Avg. 5i 


Avg. 1 


Avg. i 


Avg. 1 Avg. 5! 


Avg: 1 Avg. X 


Avg. 1 Avg. % 


Avg. il Avg. X 


0.1 1.2 ■ . 


0.2 


4.1 


ft c 

0.5 


4.3 


O.J 


D.3 


0.3 


3.1 


0.1* 2.2* 


0.8 14.9 


0.3 


14.? 


1.0 


18.3 


0.3 


13.4 


0.2 


3.4 


0.0 -0.9-. 


1.2 19.4 


0.8 


28.9 


1.3 


20.3 


0.6 


28.6 


■0.1 


0.9 


■0.1 -0.3. 


0.2 4.0 . 


0.1 


3.6 


0.2 


2.8 


0.1 


3.8- 


-0.1 


-1.3 


■CO 0.2,: 


0.0 1.7 


0.1 


1,4 


0.1 


2.6 


0.0 ■ 


0.7 


0.1 


0.9 


-0.0* -0.7 


' 0.1 2.3 


0.1 


2,3 


0.0 


0.2 


0.0 


0.7 


-0.1* 


-2.2* 


-0.1* -1.6* 


0.8 11.3 


0,6 


21.7 


1.0 


14.7 


0.6 


23.4 


0.3 


3.4 


0.1 1.8 


0.4 -- 


0.3 




1.3 . 




0.5 




0.8* 




0.2 • 


5.7 • 6.1 ■ 


•3.3 


11.1 


6.9. 


'[l 


4.0 


11.2 


1.2 


■o;i 


0.8* ' O.l'- 


0.6 0.6 


0.3 


1.2 


0.7 


0.6 


0.3 


, 0.8 


0.1 


■0.1 


-0.0' ^0.4* 


0.3 4.8 . 


0.2 


6.3 


0.2 


3,4 


. 0.2 


8.8; 


-0.1 


-1.4 


0.0 ■ 2'^^ 


3.8 -- 


'1.3 




6,6 




1-.5 




• 2.9* 




0.2 " : 


1.7 ■- . 


0.4- 




3,3 




0.4 




1.6- 




0.0 ," 


0.5. 8.3 - 


0.4 


18.4 


0.7 


10.4 


0.4 


14.4 


0.2 


2.1 


-0.0 -4.0:: 



556 



596 



"Kangary' 



Good Papers 
Holistic 3M 
Avg. I Avg. 5! 



1970 



Poor Papers ' 
Holistic ftZ 
Avg. f Avg: 3! 



^Sentence fragments. / 
;Run*on sentences 
iwlfward sentences \ 
jCipitalization errors "•' 
Misspelled words y . 
;ttrd'Choic6 errors . 
^Sentences with;agree(iient errors" 
|Total, punctuation errors - 
^^Codiw- errors 

I^Endmark errors' ' , 
Number of respondents , 



i^$tcAi6tically significant at the .05 hval,^ 
■^Figures mij not total iUe'to rounding error. 



'1979. . , ' Change 1970-79 • 

Good Papers Poor Papers ' ' Good Papers Poor Papers 
Holistic 3M Holistic 1S2 Holistic 3M Holistic IH' 
Avg. i Avg.f Avg. i Avg. 3! Avg. t Avg. - Avg. I Avg.');: 



3.1: 
■5,2: 



0.2 


3.5 . 


0.4 


9.5 


0.3 


3.6 . 


0.4 


10.4 


0.1 


-0.0 


D.l 


0.5 ,;, 


17.3 


0.2. 


11.9 


■0.6- 


14.2 


0.4 


15.0 


0.0, 


-3.1 


0.1* 


r 0.8'^ 


21.1 • 


,. 0.6 


■ 27,1 


.0.7 


15.5 


0.7 


21.9-"- 


-O.l' 


-5.7 


0.0 


0.61 




• 0.6 




., -^0.4 


0.9 




-0.1 




'0.3* 


>. 3.8 


6.5 


■3:3 


10.4 


3.9 


5.2 


4,6 


12.8 


0.2' ■ 


-1.2* 


1.4* 


-0.5 ■ 


0.7 


■ 0.4 


1.1 


0.4 


0.5 


(W 


1.2 


■0,1 


-0.2 . 


o.c 


0.5, 


10.4 


,0.3 


13.2 


0.3 


7,5 


0.4 


10.9 , 


-0.1 


-3.0 


0.1 


1.4 




. 0.6 




1.5 




1.0 




0.1 




■ 0.4* 


0.7 




0.2 




0.9 




0.2 




, 0.1 




/ 0.0 


0.3 


8.4 


0;'4 


18.3 ^ 


: 0.3 


7.2 ■ 


0.5 


22.0 i 


-0.0 


-1.2 


• 0.1* 



2.5* 

O.I.: 

"2.3! 



•384 



TABLE D-2. Average Frequency and Changes in Average Frequency of Errors in 
Narrative Papers for Good and Poor Levels of CohesiQn, Age 9, 1970, 1979t 



"Fireflies" 



Good Papers 
Cqhesion 3&4 
Avg. # Avg. % 



1970 



Senten ce f ra gmen t s ^ 0.2 

Run-on sentences *^ 0 5 

Awkward sentences^ 0^9 

Faulty parallelism 0^2 

I Unclear pronoun reference 0.0 

|rll logical constructions 0.1 

Other dysfunctional constructions 0.6 

Capitalization errors 0.3 

misspelled words 4! 3. 

Word- choice errors •. O.4 

Sentences with agreement errors o!2 

Total punctuation errors 2.9 

: Comma f rrors 1,6 

! -Endmark errors 0.4 

4 , ^Number of respondents \- 118 

>Stxiti)BHcally significant at the .05 leoel. 
\Figu2*e8 may not total due to rounding error. 



2.8 
11.1 
16.5 
2.4 
1.6 
2.1 
10.4 

5.6 
0.6 
3.6 



10.2 



Poor Papers 
Cohesion 1&2 
Avg. # Avg. % 



0.2 
0.3 
0.9 
0.1 
0.1 
0.1 
0.6 
0.3 
3.5 

0;4 
0.2 
1.3 
O.S 
0.4 



3.8 
15.5 
30.9 
4.2 
1.4 
2.3 
23.0 

11.8 
1.3 
6.8 



18.7 



438 



Good Papers 
.Cohesion 3&4 
Avg, # Avg. % 



1979 



0.3 
0.6 
0.9 
0.1 
0.1. 
0.0 
0.7 
0.7 
5.0 
0.5 
0.2 
/4.0 . 
1.9 
.0.4 



4.3 
16.1 
20.0 

2.7 
. 1.4 

0.2 
15.8 

6.4 
.0.6 
7.4 



6.8> 



117 



Poor Papers 
Cohesion 1&2 
Avg.. § Avg. % 



0.3 
0.3 
0.8 
0.1 
0.0 
0.0 

- 0.7K-r 

0.5V 

4.1 V 

0.3 ' 

0.2 

1.4 

0.4 

0.4 



6.6 
13.2 
30.0 
4.0 
0.7 
0.8 
24.5 

■12.0- 
6.8 
8.6 



.16.0 



479 



Change 1970-79 
Good Papers Poor Papers 



Cohesion 3&4 
Avg. 4 Avg. % 



0.1 
0.1 
0.0 

-d.o 
0.0 

-0.1* 
0.1 

JO. 4* 

0.8 

0.1 

•0.0 . 

1.1 

0.4 
0.0 



1.5 

5.0 
3.5 
0.3 
-0.2 

0.8 
0.0 
3. fa 



-3.5 



Cohesion IhZ z 
Avg. # Avg'. %^ 



-0 

■ 0 

0, 
. 0 
-0 



0.1* 

0.0 

0.1 

0.0 

0.0*' 

\r 
1 - 
2 

6 
0 



0.0 
0.1 

dfo 
-0.0 



-2:3;: 
-0:9^ 

-0:2 
-0.7 . 
•-1.6*'' 

1.5 

0:1 '-r 
-0.5* 
1.8>' 



-2.7 



122 
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TABLE D-l Average Frequency and Average Changes 1n Frequency pf Errors in Two 
Narrative: Papers for Selected Groups, Age 9, 1970, 1974, 1979t 



pg. i sentence fragments 

ml-? run-on sentences- 
p9.i. awkward sentences 
pyg; J faulty parallelism 
g'AVg. ,? unclear pronoun reference 
ii'Avg; X illogical constructions 

v>V.- Wil l - .1 « 



^Avg, I other dysfunctional 
|f?vconstruct1ons 
•^vg. f capitalization errors 
jivg; 1 i)isspeljed words., 
lAvg. X word-choice errors 
lAyg.' X sentences with agreenent errors 
lyg/l, total punctuation errors 
f iyg. l comma errors " 
I Avg. f endmark errors . 



; Number of respondents 



■. • • • , • 

|Avg. % sentence fragments 
pg. t run-on sentences 
liivg. X awkward sentences 
|A¥g. # capitalization errors 
pg. 'X misspelled words 
pg.;.X word-choice 'errors 
'Pi^ijX sentences with agreement errors 
1 Avg;, 1 total punctuation errofjS . 
p^vg. # comma errors 
§i^Avg. .j endmark .errors " 

p5Nu(iter of respondents 

'^^Siatistiealhj significant at. the JS Iml 
iJjPtjMrea mn not total due to rowiding error. 

. ; . • 

' ■ ; . ■ , 



1979 

Hale ' Female 



■' 1970-79 
Hale Female 
Change Change 



' 1979 . 
yhlte Black 



"Fireflies". 



"Kangaroo" 



■ 10.0 


4.4 


2.7 


■2 


" 13.2'' 


'■ 15.8. 


. / -2.7 


3 


19.6 ■ 


17.9 


-7.6* 


-3 


0.5 • 


0.8 


„, 0.0 


0 


10.3 


7.9 


'V'.o.a 


0 


0.9 


0.8 




-0 


6.9 


11.1 




•■>1 


0.9, 


1.5 




. 0 


0.4 ■ 


0.7 . , 


• o.i'V-:;- 


0 


0.4 


0.5 ; 


•0.0 ■ 


0 


■ '202 


182 ■ 







1970-79, 

yhit! ■ . Black. 
Ch -ige " Change 



7.5 


4.7 


3.9* 


1.2 


6.1 


5.2 


•? q* 


-0 9 


12.3 


15.3' 


-18 


0.7 


12.9 


18.5 : 


-1 4 


-0 8 


29.8 


25.9 


4.9 


■3.1 


25.2 ■ 


44.7 


0 9 


' 1 5 


3.9 


3.4 


-0.1 


3.5 


4.9 


-0.0 


0.6' 


0.6 


■ 1.2 


■ -0.7 


•0.5 , 


0.7 


2.0 


■- -0.9 


0.5 


1.2 


0.1 


-0.8 


-2.4' 


0.7i 


0.4 


-1.2 


-4 7* 


24,1 


21.2 


5.4 


-0.2 


20.2 


37.5 


3.0 


5.0' 


0.5 


0.6 


0.2 


0.3* 


0.5>,, 


0.5 


0.3* 


-0.1 


12.3,, 


9.3- 


0.7 


0.3 


10.7 


10.0 


. 1.1 


-2.2: 


0.8 


0.8 


-0.4 


-0.3 


0.6 


1.4 


-0.2 


-o;9 


7.4 


9,3 


0.4 


' 4.1* • 


. 6.1 


18.6 


1.3 


. 1.4 - 


1.4 


2.5 


-0.4 


0.8* 


.1.6 


2.7 


0.0 • 


o.s; 


0.4 ■ 




. -0.2 


0.3 


0.7, 


0.7 


, -0.0 , 


0.3 


0.4 


0.5 ,■ 


-0.2* 


0.2 


0.3 , 


'0.9 


-0.0 


-0.0 


259 . 


297 






357 / 


156 







Mi': ■ ' . 

if::' :■■■ 

JifiW;. ■■■■ ■ 

FRir 



123 



1- ':t 
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